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Preface 





Error-control codes may not sound like the world's most exciting topic. but it is an 
important and interesting subject, that finds applications in data communications 
(e.g. satellite communications) and data storage systems (compact disc systems). 
and applications increase as the unstopable advance of digital technology continues. 

This book has arisen out of notes put together whilst working on data commu- 
nications in industry and later teaching error-control codes at both postgraduate 
and third year undergraduate level (and it is at the later level that the book is pri- 
marily aimed at). My main sources of reference have been Error-Correcting Codes, 
Peterson and Weldon, Mitt Press, 1972 (2nd Edition); Error-Control Coding. Lin 
and Costello, Prentice Hall, 1983; and Theory and Practice of Error Control Codes, 
Blahut, Addison-Wesley, 1984. 

The basic principles of error detection and correction are first illustrated through 
the use of relatively simple codes such as single-parity-check codes and repetition 
codes. Here we address the question of what is the simplest way that we can detect the 
occurrence of errors in binary data, and then what is the simplest way that we can 
correct errors. Furthermore we see the price that has to be paid to enable erroi 
detection and correction, error control does not come free. Illustrative examples are 
given to lead the reader step by step from these basic error-control techniques 
through to linear codes, cyclic codes, BCH codes and convolutional codes. Vector 
spaces and Galois fields, required for linear codes and BCH codes respectively, are 
covered starting from a basic level to a level sufficient to understand the necessary 


codes. Where possible complex proofs have been omitted to keep the text concise 
and easy to follow. 


Keele 


S.C. 
March 2001 
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informatoon transferret wien ax ENON comnmumuo ico RERNA 3s abways 
iie to cnra 59 mouse wate: the conem] Sigis comvevinp miormanan 
cam be so cantamunaned 5» mosse thas tae zÜncmazion becomes exronenes. 11 may be 
pesseite tc; rodeos ae enel of sense cux zs compieie eumunamowm n mot posse The 
meni herzie zres to be able to peene the accucaci af miommavon m$ o 
jourmeys theougi 2 mousy chazsme! Adósenswr ths problem. Claude Shannon m 
1942. thawed that assccaced wk every chamme! ss an upper ism om the raie at 
wihuck infdormateon <am 5e tramemntiod neat throesh the chanai. Ths imnstanon 
om the capacity of a channel to traneme mformedon 1 referred 10 25 the chanel 
capacity. Fuctmermore Sbamaom prowed the exsürmor of codes thet enable mior- 
mation to be rannut through 2 mousy camel suci that the probatukty of errors 
25 nmal as requersd. providang that the tramamesmon rex Goes nol exceed ihe 
channel capacity. f formatum  tremsmitied at a rate greater than the channel 
capacity then i£ is mot posible to ackürve error-free ramsamsmon. Shannon s Dheo- 
retical work om chammel capacizy amd emor-free transmussion i now referred 10 as 
the channel coding theorem. Tae theorem Goes not sev whai the codes are OT even 
hex» we go aout hadaz them. 8 just proves thea eunea. H isa quite remarkable 
theocem 2s X tells ws thot there is mo umi to the bel of accuracy that can be 
achieved. [t seems rezsomabüe to expect a Em om the accuracy with winch infor- 
mation can be reSably transmitted, however His mot accuracy thal i lmutad bu 
rather the rate 3t whack mformation cam be tranumitied error free. 

The codes referred to im the channel coding theorem do noi prevent the occur- 
rence of errors bet rather allow thea presemce to be detected and corrected. As 
such the codes ere known 28 evror-detectiez and error-correctimg ondes of for shor 
error control codes. Erroc-coetrol codes fall ipto the categories of block codes and 
cymucimtienal code: We comsader mamby block codes, comvolunonal codes are 
considered in Chapter 3. Before introducing biock codes it 15 useful to consider the 
digital communication channel m general and then from the pomi of view of error- 
control codes. 








The phrase communication channel is used here in a wide sense to describe any elec- 
systems. For example the transfer of data between ihe main memory of a computer 
and a data-storage device can be viewed as a Communication system or subsystem. 
Applications of esror-control codes tend to fall mto the categories of digital tele- 
communication systems and data-storage systems. The main body of the theory of 
error-control codes, namely the construction of codes, encoding, decoding and 
performance evaluation. can be formulated without reference to the applications. 
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Figure 1.1 shows a block diagram of a communication system. The inf, 
source provides information, in either a digital or analogue form, to the ON 
information can be a message or data from some other system or person. The. 
encoder generates a binary signal that gives an efficient representation of the itis 
information. This may involve the use of codes, other than error-control co Patres 
minimize the number of bits needed to represent each message and allow the er 
to be uniquely reconstructed by the source decoder. If the output from the inis. 
mation source is in an analogue form, then source encoding needs to be ary 
by analogue-to-digital conversion. 

The channel encoder carries out error-control coding for the purpose of protect. 
ing information against errors incurred as it progresses through the noisy channel 
This is achieved by including additional information such that the channel decoder 
is able to accurately recover the source information despite the presence of errors. 
The transmission of information into the channel is performed by the modulator. In 
a telecommunication system the channel could typically be a wire link, a microwave 
link, a satellite link or some other type of link. The channel output feeds into the 
demodulator which carries out the inverse operation of the modulator, so pro- 
ducing a stream of bits from the received signal. The source and the channel enco- 
ders along with the modulator form the transmitter, whilst the demodulator and 
the source and the channel decoders form the receiver within the system. In a data 
storage system the modulator, the channel and the demodulator can be thought 
of as the writing unit, the storage medium and the reading unit respectively. 
The reconstruction of the source information by the source decoder is the last stage 

of the communication process, beyond this lies the information user which hopefully 


Transmitter 


POT SPESE SERE UENIT MNT RERO. 





Information Source Channel 
dulator 
source encoder encoder Mo 
Noise Channel 
j Channel 
Information Source Demodulator 


user decoder decoder 





Receiver _ 


Fig. 1.1 Block diagram of a communication system. 
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4 | Block codes 
1.2 Introduction to block codes 


A block code is a set of words that has a well-defined mathematical propert 
structure, and where each word is a sequence of a fixed number of bits, The ma 
belonging to a block code are called codewords. Table 1.1 shows an example ^ 
simple block code with 4-bit codewords and where each codeword has odd navi, 
(i.e. an odd number of ones). Note that a word with m bits is referred to as ^s 
m-bit word. 

A codeword consists of information bits that carry information per se, and parity. 
check bits (also referred to as parity bits or check bits) that carry no information 
in the sense of that carried by the information bits, but ensure that the codeword 
has the correct structure required by the block code. Blocks of information bits, 
referred to as information words, are encoded into codewords by an encoder for the 
code. The encoder determines the parity bits and appends them to the information 
word so giving a codeword. A code whose codewords have k information bits and 
r parity bits, has n-bit codewords where n = k + r. Such a code is referred to as an 
(n,k) block code where n and k are respectively the blocklength and information 
length of the code. The position of the parity bits within a codeword is quite arbi- 
trary. They can be dispersed within the information bits or kept together and placed 
on either side of the information bits. Figure 1.4 shows a codeword whose parity bits 
are on the right-hand side of the information bits. A codeword whose informa- 
tion bits are kept together, so that they are readily identifiable, is said to be in a 
systematic form or to be systematic, otherwise the codeword is referred to as non- 
systematic. The codeword in Fig. 1.4 is in a systematic form. A block code whose 
codewords are systematic is referred to as a systematic code. For clarity systematic 
codes are normally preferred to nonsystematic codes, however there are reasons 
for sometimes preferring nonsystematic codes (see Section 3.4). 


Table 1.1 
An odd-parity block code with 4-bit 
codewords 


(0001) 
(0 0 1 0) 
(0 1 0 0) 
(1 0 0 0) 
(0 1 1 1) 
(11 1 0) 
(110 1) 
(101 1) 








n= k+r bits 


k r 


Information bits Parity bits 





Fig. 1.4 An n-bit systematic codeword. 
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Table 1.2 
The (5, 4) block code with odd parity 
Codewords Redundant words 
00001) 00000 
00010 00011) 
00100) 00101) 
(QO117U (0011 0) 
(01000! (01001 
(0107 1) (01010! 
(01101 (01100 
(01110! (011110 
(10000 (100010 
(1001 1) (100 10) 
(10101) 110100) 
(10110) (10110 
(11001) (11000! 
(11010 (1101 
(11100 (11100 


11110 





In an (n, k) block code each different information word gives a codeword. As Å 
bits give 2* different words there are therefore >» codewords in an (n. Kk) code. 
Consider the (5, 4) block code, with odd parity. shown in column 1 (the left-hand 
side column) of Table 1.2. The code has 4 information bits and therefore 2* = 16 
codewords. The parity bit is on the right-hand side of each codeword and the code 
is in a systematic form. A 5-bit word gives 32 different words of which 16 have odd 
parity and are therefore codewords of the (5, 4) code. The remaining 16 words, 
shown in the second column, have even parity and are redundant to the code, these 
are referred to as redundant words. If information within a system is represented 
in the form of codewords then the presence of a redundant word can only be due 
to the occurrence of errors. It is by adding redundancy to information that error 
detection can be carried out. Furthermore it may be possible to carry out error 
correction if there is sufficient redundancy. The (5. 4) block code enables some 
degree of error detection but no error correction. Section 1.4 gives the first example 
of an error-correcting code. 

In an (n,k) block code we can think of the code's structure as partitioning Or 
separating 2" words into two sets: 


(i) the ?* codewords having the required structure; 
(ii) the 2" — >» redundant words not having the code' s structure. 


Consider the even-parity (4, 3) block code shown in Table 1.3. Column I (on the left- 
hand side) shows the code's 8 information words and column 2 shows all the dif- 
ferent words of a 4-bit word. The code's requirement that words have even panty 
separates the words in column 2 into codewords and redundant words, shown in 
columns 3 and 4 respectively. There are 2*— 2^ =8 codewords and 2"— 2*— 
2* _ 3 =8 redundant words. The ‘space’ between some of the codewords, in column 
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Table 1.3 
The (4, 3) block code with even parity 


LI 
3-bit words 4-bit words Codewords Redundant ion 
5 


(0 0 0) (0 0 0 0) (0 0 0 0) 
(000 1) (0001) 
(0 0 1) (0 0 1 0) (0010) 
(001 1) (001 1) 
(0 1 0) (0 1 O 0) (0 1 0 0) 
(0 1 0 1) (0 1 0 1) 
(0 1 1) (0 1 1 0) (0 1 1 0) 
(0 1 1 1) (0 1 1 1) 
(10 0) (10 0 0) (10 0 0) 
(100 1) (100 1) 
(1 0 1) (10 1 0) (10 1 0) 
(101 1) (101 1) 
(1 1 0) (1 100) (1 100) 
(1101) (1101) 
(11 1) (11 1 0) (11 1 0) 
(11 1 1) (111 1) 





3. reflects the redundancy added by the parity-check bits. Increasing the number of 
parity-check bits has the effect of increasing the redundancy and so 'pushing' the 
codewords further apart. The further apart the codewords, the more likely it is that 
errors will be detected and corrected. The idea of codewords being separated by 
redundancy leads to the notion of distance, this as we shall see is fundamental to 
the theory of error-control codes. 
A useful measure of the redundancy within a block code is given by the ratio of 
the number of information bits to the blocklength 
"E 
n 
and is known as the code rate. For a fixed number of information bits the code rate R 
tends to 0 as the number of parity bits r increases. Low code rates reflect high levels 
of redundancy. In the case of no coding there are no parity bits and so n — k and 
the code rate R — 1 (whilst this is of no practical interest it does nevertheless set an 
upper limit to the code rate). We can see that the code rate is therefore bounded by 


0S KI. 


A word with n bits can be represented by a vector with n components. For nov 
we associate words with vectors in a rather loose way, purely for the purpose ° 
representation. In Section 5.6 a formal definition of codewords in terms of vectors 
is given. 

For an (n, k) block code the input to the encoder is the information word 

i= (ils... i) 
where ij=0 or 1 and j is an integer 1<j<k. The encoder determines ran-k | 
parity-check bits p;,p2,...,p, according to the encoding rule of the code and Í 





——— 
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appends them to the information bits so giving the codeword 


c= (i, in, rre Ie Pi, Pr; (oa Py}. 


The encoding rule of a code is such that the combination of the parity bits and the 
information bits (i.e. the codeword) has the mathematical property required by the 
code. It is usual to represent codewords as 

€ 9 (04,02, +++ , 0.) 


where 


G=h forlcjzck 
= p-k Nork<jon. 
Errors can also be represented by vectors, An n-bit codeword is liable to a maximum 
of n errors which can be represented by the error vector or error pattern 
gw (ej, €, (^24 €0) 


where 


ej=1 if there is an error in the fth position 
=Q if the position is error free, 


A codeword c that incurs an error e results in the word 
y=cre (1.1) 
where the components of v are given by the components of c and e added pairwise 


y zx (04,42, ^. + ^0.) (Eppa rs , €n) 
= (Cy + E1, C2 €2,.. Cn t Cn) 
- (Vi, V2, .. » , Vn) 


where v,— c;4- e, for | <j € n and where modulo-2 addition (see Table 1.4) is used 
when adding c, and e; together. From Table 1.4 we see that 1 +1 =0, which gives 
—] =1 and so subtraction is equivalent to addition when using modulo-2 addition. 
To emphasize the use of modulo-2 addition we sometimes use the notation | + ] = 
0 modulo-2. Note that for two bits b, and b; we get 


b, +b, = 0 modulo-2 if b, = b; 
b, + b, = modulo-2 if b, # by. 


Table 1.4 
Modulo-2 addition 


04-00 
0-121 
14 0z1 
14-120 
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The word v represents the codeword after i has been subjeeted tà the FOE v, Uf yi 
the components of e are zero, then Lr 


Vi t'i 
v2 SS (73 
Vy = Ch 


and therefore v = e, otherwise v # e. Equation E Eis central to the decoding proves 
A decoder has no a priori knowledge of e, the only information that it hasis the word 
y that it receives, which is referred to an the received word or the decoder input, Vor ay 
error-detecting code the task of the decoder is to establish whether vis a codeword 
This can be achieved by checking v against a table of codewords or by checking 
whether v has the mathematical property required by the code (e.g. If v has the 
correct parity). For an error-correcting code the decoder has to estimate or guess 
the codeword from v. Vf the decoder's estimate of the error pattern is e then, from 
eqn 1.1, its estimate of the codeword is é — v — e, and given that modulo»? addition 
is used then 


 cypdé (1.2) 


is the decoder's estimate of e, Whether a decoder can determine the correct code: 
word from v depends upon the code, the errors incurred and the decoding algorithm, 


1.3 Single-parity-check codes 


The (4, 3) even-parity and the (5,4) odd-parity block codes considered in the pre: 
vious section are just two examples of the s/nglesparit yscheck codes, These are n class 
of error-detecting block codes that give the simplest form of error control, The codes 
use a single parity bit to generate codewords with even or odd parity (Le, an even ot 
odd number of ones respectively), For all integer values k > | there exists an (nk) 
single-parity-check code with n= k 4 I. | 

A good example of a single-parity-check code is the (8, 7) block eode used in the 
American Standard Code for Information Interchange (ASCH ). The ASCII formal 
uses 10-bit words to represent alphanumeric characters (vee Fig, 1,5). The first 
and last bits are the start and stop bits respectively, these are not used for error 


(8,7) Block code 
adip ee E — 


—— -— EE on * - i Ae "€ RE 


-— P — Ion 


"— 


-— — aa ^o——ÀÁ— Ds e t — Ss» 


7 Information bite m 


Start Parity Stop 
bit bit — bit 


Fig. 1.5 The ASCII format, 
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control but help to achieve word synchronization. The remaining 8 bits consist of 
7 information bits, used to identify a particular character, and a parity bit to provide 
some degree of error control. The parity bit is set to 0 or 1 depending upon the 
information bits and the parity required. 

For an (n,k) even-parity code with information bits £j, i2,- .. íp the parity bit 
is given by 

p—hctict:c od (1.3) 

where modulo-2 addition is again used. If the information bits contain an even 
number of ones then p=0, otherwise p— 1. If odd parity is required then 
p — (i dod dg) 1 where now p=1 if the information bits contain an even 
number of ones. Appending p to the information bits gives the codeword 


ess (hb, p). (1.4) 


Example 1.1 
Given the (5,4) even-parity block code find the codewords corresponding to 


ij, — (10 1 1) and i; z (10 1 0). 
Consider first the parity bit for i; — (1 0 1 1). Using eqn 1.3 the parity bit is given by 


p214041-41. 


Recall that modulo-2 addition is used and so 


040-20 
0+1=1 
1+0=!1 
1+1=0. 


The bits in p; can be added together two at a time, therefore p, can be written as 


* 


pi = (140) 9 (14 1) 


which gives 


Pi =1+0 
and so 
P= l. 
Using eqn 1.4 the codeword for i, — (1 0 1 1) is therefore 
c = (101 1 pi) 2: (101 l 1). 
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Likewise for i; — (1 0 1 0) the parity-check bit is 


po 7140-140 
— (1-- 0) —- (1-- 0) 
=1+1 
ss p) 


which gives the codeword 


c)—(101055)—-(101090). . 
Equations 1.3 and 1.4 describe the encoding stage of a single-parity-check code. At 
the decoding stage the input to the decoder is the received word 


y = (vi, Vz,..., Vn) 


which may or may not be a codeword, depending on whether any errors have 


occurred. To check whether v is a codeword, the decoder determines the parity- 
check sum 


s—» 444» (1.5) 


where s — 0 and s = 1 when v has even and odd parity respectively. Consider now an 
even-parity code, If s — 0 then v has even parity and is therefore a codeword. If s= | 
then v has odd parity and is therefore not a codeword, this is knowri as a parity-check 
failure. If there are no errors then s = 0 and vis a codeword, however the occurrence 
of a single error changes the parity of a codeword to odd, resulting in a parity-check 
failure. The decoder is therefore able to detect all single-bit errors irrespective of the 
position of the error within the codeword (including an error in the parity bit). Two 
errors, however, do not alter the parity of v and so s = 0 as obtained when no errors 
occur. The decoder is therefore unable to distinguish between the occurrence of two 
errors and no errors. 


Example 1.2 
Given the (8,7) even-parity code determine whether v, — (1 0 1 1 0 1 1 0) and 
y5—(0110100 1) give parity-check failures. 


The parity-check sum for v, is 
5) =14+04+14+14+04+14+1+4+0=1 
and so v; gives a parity-check failure. However for v; we get 
s=0+1+1+0+1+0+0+1=0 


which is the correct parity-check sum for an even-parity code. s 


It is easy to see that the occurrence of an odd number of errors always give t | 
whilst an even number of errors gives s=0. When s= 1 the decoder knows t d E 
at least 1 error has occurred. However, when s=0 the decoder has no a pri? 3 
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way of knowing whether this is due to no errors or the occurrence of an even 
number of errors. The decoder cannot distinguish between the events that can give 
rise to 5— 0. In a binary symmetric channel the probability of obtaining r errors 
decreases as r increases, and so a zero parity-check sum is more likely to be due to 
0 errors than 2 errors, or any other even number of errors. The best decision that 
the decoder can make is to assume that if s = 0 then no errors have occurred. Such an 
approach, where 'the most probable reason' is used to make a decision is referred to 
as a maximunm-likelihood decision and the decoder known as a maximum-likelihood 
decoder. The decoder is basically making a guess, but it is more likely to be right than 
wrong. 

Decoding an odd-parity code is the same as decoding an even-parity code, except 
that s = l is taken to indicate correct parity. A word of caution is appropriate here, 
the use of the words ‘odd’ and ‘even’ when describing the type of parity should not be 
confused with their use when describing the number of errors. Given that even- 
parity codes detect odd numbers of errors, then odd-parity codes do not detect even 
numbers of errors, they too detect odd numbers of errors. 

The error-control capabilities of the single-parity-check codes are quite poor, a 
measure of the codes’ performance can be obtained by considering all the possible 


outcomes at the decoder. Consider a codeword c which at the decoding stage gives 
rise to the received word v and let: 


p, — the probability that the decoder gives the correct codeword c; 
p, — the probability that the decoder gives an incorrect codeword c' x c; 
p; — the probability that the decoder fails to give a codeword. 


These give the three possible outcomes at the decoder, namely correct decoding, a 
decoding error and a decoding failure for pe, Pe, and p; respectively. Note that correct 
decoding is also referred to as successful decoding. A decoding failure occurs 
whenever an uncorrectable error pattern is detected, the decoder does not return 
a codeword and in this sense decoding is said to have failed (i.e. failed to return a 
codeword). Note also that the decoder never knows whether decoding has been 
correct or incorrect, it is only aware of decoding failures. There are no other possible 
outcomes at the decoder and therefore 


Pot Pe t+ Pt = l. 


Expressions for pe, Pe, and pr can be found by first considering the probability of 
obtaining j errors in an n-bit word. The number of ways (combinations) of having 
j bits in error, out of n bits, is "C, where 

"C, = n! 
! o (n-J)! 
and if p is the bit-error probability then 
P, = "Cp (1 - p)" (1.6) 


is the probability of obtaining j errors in an n-bit word. If v contains no errors then 
y will have the correct parity and the decoder will correctly assume that v is the 
required codeword. Hence the probability of correct decoding pe is given by the 


i 
| 
| 
i 
f 
j 
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probability of no errors occurring, i.e. by taking  — 0, and so 


hs = dh. 
me (1.7) 


occur, 
taking 


The decoder gives an incorrect codeword whenever an even number of errors 
as this preserves the correct parity so making the errors undetectable. Hence 
) — 2. 4. O, EAS gives 

p, = Pa Pa + Pob Py T 
where n' =n ìf n is even, otherwise n' =n — l. In the event of an odd number of 
errors the parity of v is incorrect and the errors are therefore detected. The decoder 
has no way of establishing the number of errors or their positions and therefore 
the decoder is unable to return a codeword. Hence the occurrence of odd numbers 
of errors causes a decoding failure, and so taking j= 1, 3, 5.... gives 


pp = Py Py Ps Py (1.9) 
where this time n’ =n if is odd, otherwise n' —n- l. 


Example 1.3 
Given the even parity (5,4) block code find pe, Pe and py for (i) p=0.1 and 
(i) p = 0.001. 


(i) For the even parity (5, 4) block code n = 5 and we substitute n’ = 4 and n = 5into 
eqns 1.8 and 1.9 respectively. This, along with eqn 1.7, gives 


pc = Po 
Pe = P2 + P4 
p= Pi + Py tPs 


Using eqn 1.6 and taking p = 0.1 gives 


Py = 5Cop*(1— p)? = (1 — p) = 0.5905 

P, = Cp! (1 — p)* = Sp(1— p)! = 0.3281 | 
P; = °Cop*(1 — p) = 10p?(1— p) = 0.0729 
P, = °C3p3(1 — py = 10p?(1— p)? = 0.0081 | 
P4 = 5Cap*(1— p). = Sp*(1 — p) = 0.0005 
Ps =°Csp°(1 —p) = p? = 0.00001. 


Substituting Po to Ps into Pe, pr and pe gives 


Pc = 0.5905 
Pe = 0.0734 
pr = 0.3361 


note that p, + p. + pr = 1 as required. 





rm — - — meh o— : es "ENT > 
ee — Y" VW UP. 
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(ii) Repeating the above with p — 0.001 gives 


Py = 0.9950 
P, = 498 x 10? 
P = 9.97 x 107° 
P; = 9.98 x 107° 
P4 = 5 x 107" 
P; = 1x107" 
and so 

pe = 0.9950 

Pe = 9.97 x 1075 
pr = 4.98 x 107 


which again add to 1 as required. Note that when p — 0.1 only 59% of codewords 
will be received error free. Whereas when p —0.001 over 99% of codewords are 
error-free. L] 


The expressions for pe, Pe, and pr can be written in terms of the bit-error prob- 
ability p by substituting eqn 1.6 into eqns 1.7, 1.8, and 1.9. The probability of 
correct decoding is then given by 


fx = Py = "Cop" (1 py? 


which gives 


Pc = (1- p)". (1.10) 
The probability of a decoding error becomes 


n' 


p= X. "Opll- py"? (1.11) 


j=2(even) 


where the series summation is over even values of j and where »' =n if n is even, 
otherwise n' =n — 1. The probability of a decoding failure is 


, 
n 


p= $5 "Opl- p)? (1.12) 
J=\(odd) 


where now n’ = nif nis odd, otherwise n' =n — 1 and the summation is now over odd 


values of j. As a check it can be easily shown that the sum of Pcs Pe, ANd pr gives 1. 
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Adding eqns 1.10, 1.11, and 1.12 together gives 


n / 


po pet pr (0. — p». "Ojpl(1— py + 2. "Op 


| —~ piits 
j=2(even) J=1(odd) p) j 
= (1— p)" 4 5 "Cp - p)? 
j=l 


n 


= 2 "Op - p)" 


where we have made use of the binomial expansion theorem 
n 


(a b)" 2 5 ""Cja/p"l. 


j=0 


Example 1.4 


Given the (8,7) single-parity-check code, with even parity, find the probability of 
correct decoding, a decoding error and a decoding failure when p=0.01. 


Substituting p=0.01 and n=8 into eqn 1.10 gives the probability of correct - 
decoding as: 


pe = (1 — p)" = (1 — 0.01)? = 0.9227. 
The probability of a decoding error is obtained by letting n’ =n =8 in eqn Nis 


; 8 
pe = #Cap°(1 — p) + ®Cap'(1 — p)* + Cept (1 — p) + "Cup 
| 28p^ (1 — p) + 70p*(1 — p)* + 28p$(1— p)^ + p* 


"——— —— 


and substituting p = 0.01 gives pe = 0.0026. h | 
We could find p, using pr — | — ( Pe + pe), however we will use eqn 1.12 to obta | 


p, and then check that pe + pe + pr= 1. Letting n — 8 and n =7 in eqn 1.12 we t 
pr = *Cip(1 — p)! + *Cap! (1 — py + 5Csp*(1 — p? + *Cop' (1 — p) 
= 8p(1 — p)' + 56p*(1— p)? + 56p°(1 — p)? + 8p'(1— p) 


which gives py = 0.0746 when p = 0.01. g 
Adding together pe, Pe and p, gives 1, so the results are consistent. 


nd | 

In eqns 1.7 to 1.12, pc, pe, and prare probabilities with values lying between ir ^ 
1, Multiplying each term by 100 gives values of 0 to 100%, in which case Pes Pe: è? ely: 
can be referred to as the success rate, the error rate and the failure rate respect! | 





ee ERE 
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If p< 1 we can obtain approximations to p, and pr by neglecting the occurrence 
of 3 or more errors. This then gives 


Pe © P) 
pr = Py. 


There is no need to approximate p, as this can be easily determined from eqn 1.10. 


Example 1.5 
Repeat Example 1.3 using pe% P; and pe% P}. 


For p— 0.1 we get prz: n 28 x 107! and pe% 7.29 x 1077, compared to prz: 3.36 x 
10^ ' and pe = 7.34 x 10 ^ obtained in Example 1.3. For p = 0. 001 we get pp 4.98 x 
107^ and p,2:9.97 x 1075, compared to pr=4.98 x 10? and p.=9.97 x 19 ^ 

obtained in Example 1.3. Note that there is greater agreement between the values 
obtained using eqns 1.8 and 1.9, and their corresponding approximations when 


— 


p — 0.001 than when p — 0.1. This is clearly to be expected. C 


1.4 Product codes 


The single-parity-check codes have no error-correction capability, they can only 
detect the occurrence of odd numbers of errors. However, error correction can be 
achieved by combining two single-parity-check codes in the form of a rectangular 
array as shown in Fig. 1.6. Each row in Fig. 1.6 shows a 4-bit word encoded into 
5 bits using a (5,4) single-parity-check code. Even parity has been used and the 
parity bit is on the right-hand side of each row. After the sixth word a (7, 6) code is 


Information How 
bits Í 


Column 
parity checks 





Fig. 1.6 A (35,24) product code. 





 C————————————————"———— 
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used to encode bits within the same column. Again even parity has been y 
the parity bits are now at the bottom of cach column. here are therefore tw, Lj 
parity bits, row and column parit y-check hits. At the bottom right-hand corner of 
array is an overall parity-check bit which can be gener ated from either Code as ^ 
pive the same parity check. There are a total of 35 bits in the array, of which 7A 
information bits and 1] are parity-check bits. The two codes can therefore 
thought of as a single (35, 24) block code. It is referred to asa Product eode beca 
n and k are given by the product of the blocklengths and of the info 
lengths of the individual codes, we can think of this as a (5,4) x (7, 
4 x 6) -— (35,24) code, Codewords now take the form of arrays and as 
lerred to as code arrays, Product codes are also refe 
because of the rectangular appearance of codewords, 
When decoding a product code, parity-check sums are calculated for rows aud 
columns, In the event of the array containing no errors there will be no parity-check 
failures, and the array will be taken as the required code array. The occurrence of a 
single error gives parity-check failures in the row and column containing the error. 
and the decoder can determine the error position from the intersection of the row 
and column parity-check failures. Figure | .J(a)shows an example of a single error in 
a code array belonging to the (35, 24) product code. The erroneous bit is enclosed ing 
circle and the resulting parity-check failures are shown by the highlighted row and 
column, The error position is uniquely determined by the intersection of the high- 
lighted row and column, and the error can therefore be corrected. Figure 1.7(b) 
likewise shows a single error, in a different code array to that shown in Fig. 1.7(a), 
which again can clearly be located and corrected. Figure 1.7(c) shows two errorsin 
the same column but different rows, Here the parity check in the míddle column is 
correct, but there are two row parity-check failures and there is no way of esta- 
blishing the position of the errors within the two rows, The same problem arises 
when there are two errors in the same row but different columns. Two errors ín 
different columns and different rows give four points of intersection and again there 
Is no way of uniquely establishing the error positions (see Fig. 1.7(d)). The next 
example, Fig, 1.7(e), shows three errors arranged in an 'L' shape, resulting in the 
parity-check failures intersecting at a correct bit, This therefore appears as a single 
error and a decoding error occurs. Finally, Fig. 1.7(f) shows four errors on the 
corners of a rectangle, there are no parity-check failures and the errors are unde- 
tectable, In summary we can say that the (35, 24) product code corrects all single 
errors and detects a large number of other error patterns. The outcome of the 
decoder depends on the number of errors and their arrangement. A product code can 
be constructed from any two single-parity-check codes, furthermore given any two 
block codes (ni, k,) and (n5, k2) an (nins, ky ky) product code can be constructed. 


; atid 


J 
äre 


Tation 
6)- (553 
SUCH are re, 
rred to as rectangular code 


1.5 Repetition codes 


The repetition codes, as the name 
two or more times, They are 
a single information bit and 
Is referred to as an (n, 1) re 


suggests, are codes that repeat information bits 
block codes in which the parity bits are set equal to 
If the number of parity bits is n — 1 then the code 
petition code, As an example we consider the (3,1) 


———— -——"———— 
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(a) Single error (b) Single error 





(c) Double error (d) Double error 





(e) 3 errors (f) 4 errors 
0 1 0 1 O0 
Go (Ds 1: 
O0 1 0 1 OQ 
t 0. 1 D 6 
0 1 (9: 4 
ot i 1 1 
1 O 1 1 1 





Fig. 1.7 Error patterns in the (35,24) product code. 
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(a) Encoding 


Information Codeword 
bit 
0 —> 0 0 Q 
1 ——» ; 747 3j 


(b) Majority-vote decoding 


Output 
—— P e 
Input Decoding Codeword Information 
decision bit 
0 0 O0 —— —» Assume no errors ——-—» 0 0 0 — 0 
0 0 1 
O 1 0 ‘tc BIOL dotocion — Ls. 0 0 0 — 0 
Assume 1 error 
1 0 0 
O 31 1 
1 O0 1 o,» Error detected » 1 a a 1 
Assume 1 error 
1 1 0 
1 3 1 ——» Assume no errors ——» 1 1 1 — 1 


Fig. 1.8 The (3,1) repetition code. 


repetition code in which two parity bits are set equal to an information bit. Encoding 
is straightforward as shown in Fig. 1.8(a), the information bits 0 and 1 are encoded 
into the codewords (0 0 0) and (1 1 1) respectively. Note that the word ‘parity’ is still 
used to describe the check bits, even though the check bits are not used for setting 
even or odd parity. | 
At the decoding stage a majority vote is taken to establish whether the original i 
information bit was a 0 ora 1. The majority vote assumes a 0 information bit ifthere — | 
are more zeros than ones, otherwise it assumes a 1 as there will be more ones tha? — | 
zeros (see Fig. 1.8(b)). The majority vote is a maximum-likelihood rule because" —. 
effectively bases its decision on the number of errors that are most likely to hav | 
occurred. For example, given (0 1 0) it is more probable that this correspon ds | 
(00 0) with a single error, rather than (1 1 1) with 2 errors. Likewise, given (1 1 DI? | 
more probable that this corresponds to (1 1 1) with no errors, rather than (000) with 
3 errors. If no errors occur then the decoder input will be (0 0 0) or (1 1 1) an rs 
majority vote gives 0 or 1 respectively, both decisions being correct. If one oft 
codewords incurs a single error then the majority vote will always give the cort 
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codeword and information bit. So (0 0 0) with | error gives (0 0 1), (0 1 0) or (1 0 0) 
all of which are correctly decoded by the majority vote. However, if (0 0 0) incurs 
2 errors then the majority vote is taken over (0 1 1), (1 1 0) or (1 0 1) and so giving 
the incorrect codeword (1 1 1). Triple errors obviously give an incorrect codeword 


and lurthermore the decoder is unaware of the errors. Note that for the (3, 1) code 
a majority vote over (Vis Va, V3) gives 


| = VaV? + Vaya + Vang 
as the required information bit. For example given (0 1 1) then 


i=0.1+41-141-0=1 


and for (0 1 0) we get 


i=0-1+1-04+0-:0=0 
which are clearly correct. 


In Section 1.3 expressions for thé probability of correct decoding pe, a decoding 
error p, and decoding failure p; were determined for the single-parity-check codes. 
Similar expressions can easily be obtained for the repetition codes. With the single- 
parity-check codes correct decoding occurs only when there are no errors and so, as 
we saw in Section 1.3, p. 7 Po where Po is the probability of obtaining no errors in an 
n-bit word (see eqn 1.6). However, with the (3, 1) repetition code single errors are 
corrected and so decoding is successful when 0 errors or | error occur. Therefore 


p, = Py + Py = (1 py + 3p(1 — p) (1.13) 


where Py and P, give the probability of getting 0 and | error in a 3-bit word 
respectively and again p is the bit-error probability. The occurrence of 2 or 3 errors 
gives a decoding error and so 


De = Pa + Py =3p'(1-p) +P (1.14) 


where P» and P; are the probability of getting 2 and 3 errors in a 3-bit word 
respectively. The (3, 1) repetition code always gives correct decoding or à decoding 
error, it never gives a decoding failure because a majority vote can always be made 
irrespective of the number of errors. Majority voting, over an odd number of bits 
(as considered here) is an example of complete decoding, \t never fails to give a 
codeword (even though it may be the wrong codeword). Hence the decoding failure 
rate is zero, and so 


Pt = 0. 


A decoder in which the failure rate is nonzero is referred to as an incomplete decoder, 
thiscan return codewords as erroneous and uncorrectable (i.e. decoding failures can 
occur). A zero failure rate may seem like a good characteristic ofa a pon 2: 
is not necessarily the case. Whilst a complete decoder gives a p ^ = = - 
probability of a decoding error is larger than that of an incomplete decoder tor te 





de 
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same code (note that complete or incomplete decoders can be used f 

Complete decoding is normally used when it is better to have the ber ON od. | 
codeword as opposed to nothing at all, however in doing so more q t E Sof, 
will occur. If a low probability of decoding errors is required then a "" 
decoder is better suited. A NcoMple, 


Example 1.6 
Given that an information bit is encoded using the (3, 1) repetition coq 
probability p, that the bit is correct after decoding when the bit 
p — 0.01 and when p — 0.001. 


e find th. - 
"€TTOF probabifi, 


Substituting p —0.01 into eqn 1.13 gives p.= 0.999702 and p=0.001 v 
p. = 0.999997. Furthermore the probability of the bit being incorrect after dec a 
is 2.98 x 1074 and 3.00 x 10-° for p=0.01 and p — 0.001 respectively. 5 
The (3, 1) code is just one example of a repetition code. For any positive integer; | 
there is an (n,1) repetition code that has  — 1 parity-check bits all equal to a singe. 
information bit. If the blocklength n is even, decoding failures occur in the event of 
n/2 errors, because a majority vote over an equal number of zeros and ones does not 
give a unique answer, decoding is therefore incomplete. Hence the blocklength nis | 
usually taken to be odd as this avoids the problem of an even number of zeros and 
ones, so giving complete decoding. An (n, 1) repetition code has two codewords— 
the words with n zeros and n ones. As the blocklength n increases, the number of 
errors that can be corrected also increases. Consider the (5, 1) repetition code with 
codewords (0 0 0 0 0) and (1 1 1 1 1). Assuming that 2 errors occur in (0 0000): 
giving, for example, (0 1 0 0 1) then a maority vote taken over (0 1 00 1) gives the 
correct codeword (6 0 0 0 0). The occurrence of 3 errors, to give say (10 1 10), will 
resv't in the decoder giving the wrong codeword (1 1 1 1 1). The (5, 1) repetition code — 
is able to correct up to 2 errors and is therefore a double-error-correcting code. — 
Clearly an (n, 1) repetition code can correct up to (n — 1)/2 errors. If the blocklength — 
n is even then (n — 1)/2 is rounded down to the nearest integer. ae 
Expressions for the probabilities of obtaining correct decoding and a decoding : 
error for an (n, 1) repetition code are readily obtained by extending the expressio 
for p, and p, already given for the (3,1) repetition code (eqns 1.13 and 1.14 
respectively). Assuming n to be odd then 


Pe = Pot Pi +- + Pini) 
1 
and | 
i 
Pe = Pinsiys2 + Pintay + °° + Pn = 1 — Pe 


a - 6 
where P, is the probability of obtaining j errors in an n-bit codeword (see eqn 1.6) 


and 0 <j € n. In terms of the bit-error probability p these give 


(n=1)/2 
Map ud 1.15) 
p= 3, "Op'(1- p)" A 


j-0 
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and 


"n 


p= "Cpl(1-— py"? (116) 


bn 1/2 


The probability of a decoding failure p; — 0, as we have already seen for the 3, 1) 
code, as so ped p, I. 


Example 1.7 


^ (7, 1) repetition code is used to encode information sent through a channel with 


a bit-error probability of 0.01, Find the probability that an information bit is 
erroneous after decoding. 


^ decoding error occurs whencver 4, 5, 6, or 7 errors occur, and the probability of 
this is given by substituting 7# = 7 into eqn 1.16, so giving 


lg ' y os 
Pe = Cap! (V = p)! "Cap! (1 = py! + " Cop*(1— pf + 7C yp’ 


Substituting p: 0.01 into pe gives p. — 3.4 x 107, Hence approximately 1 bit in 
every 3 x 10" bits are erroneous, compared to | in every 100 if information bits are 
»ent through the channel without the use of the (7, 1) code. L] 


Examples 1.6 and 1.7 show that for p — 0.01 the probability of a decoding error 
is 30 x 10 “and 3.4 x 10 7 for the (3,1) and (7. |) repetition codes respectively. 
Table 1.5 shows values of p, for repetition codes with odd blocklengths up to 
n ll and à bit-error probability of p — 0.01. As the blocklength n increases, the 
probability of obtaining an incorrect bit decreases significantly. However this is at 
the expense of the high levels of redundancy required by the codes, as indicated by 
the low code rates R (also shown in Table 1.5). 

As already mentioned, a repetition code with an even blocklength gives incom- 
plete decoding and therefore a nonzero decoding failure. This is considered in the 
next example. 


Example 1.8 
Determine the probability of a decoding failure for the (6.1) repetition code. 
assuming a bit-error probability of 0.01. 


^ decoding failure occurs whenever a codeword incurs 3 errors because the errors 
are detectable and a majority vote will fail (as there will be an even number of zeros 








Table 1.5 
Probability of decoding errors for repetition codes 
n Pe R 
" 3.0x 10^ 0.33 
5 99x10 0.20 
7 34x107 0.14 
9 1.2 x 10° 0.11 
11 44%10°'° 0.09 
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and ones). The probability of obtaining 3 errors in a 6-bit word is given b bon 
n —6and /=3 in eqn 1.6, which gives y etting 


P3 = °C3p*(1 — py 


and substituting p — 0.01 gives P4 = 1.94 x 10 °. The probability of 4 decog; 
failure is therefore pp — P3 = 1.94 x 10 ?. ding 


J 

The repetition codes provide us with a very simple way of carrying out err 
correction and may be suitable in a system where a high level of redundancy j 
acceptable. But if a channel is to be used efficiently so that high levels of redundane, 
are not acceptable, then the repetition codes are quite inadequate and error. 
correcting codes are required that make better use of redundancy, 


1.6 Hamming codes 


The single-parity-check codes, product codes and repetition codes considered in 
the previous sections can be thought of as ‘first steps’ towards achieving error 
control. The codes allow a limited degree of error detection and correction, and are 
simple to implement. Moving on towards somewhat more interesting codes are 
the Hamming codes which were the first class of linear codes devised for error 
control and as we shall see, in Chapter 2, linearity is a good property for a code to 
possess. The Hamming codes occupy an important position in the history of error- 
control codes and we will refer to them repeatedly throughout the book. Here the 
Hamming codes are introduced and later they are reconsidered in terms of their 
linear properties. 

The first in the class of Hamming codes is the (7, 4) code that takes 4-bit infor- 
mation words and encodes them into 7-bit codewords. Three parity-check bits are 
required, these are determined from the informatiorr bits using eqns 1.17 shown 
below. Given an information word i= (i, i», i>, i4) then the parity-check bits are 


A=H=hyth+h 
Pp = h + i} + l4 (1.17) 
p3 =li + i+ i4 


where the information bits are added together using modulo-2 addition (see 
Table 1.4). Appending the parity bits to the information word gives the codeword 


pw (i1, (2, 13, i4, P1, P2, p3). (1.18) 


Table 1.6 shows the set of codewords for the (7, 4) code. There are 16 codewords, one 
for each information word. For reference purposes, the codewords and information 
words are labelled co to c,5, and iy to is respectively. The subscript i of the codeword 
c, gives the numerical value of the corresponding information word, for example ¢s 
is the codeword corresponding to the information word i; — (100 1). Note that here 
as with the repetition codes, the word ‘parity’ does not refer to whether there are añ 
even or odd number of ones in a word, but rather refers to the code’s check bits 
irrespective of the code’s property or structure. 
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Table 1.6 
The (7,4) Hamming code 

Information words Codewords 

be ih, beh) € = (hy, by, Éz, la. pi. pa. Pa) 
h (0066; co 7 (0 0 0006090) 
i (0091) c(—(000101 1j 
b= (0010) €; (0606101 19 
íi 001 1j €1—(0011101j 
ig (010960 €4:-(0 1 00 1 1 i) 
iz (0 1 0 1j e;—(01011098) 
l4 — (01 1 ()j ~%=(0119000 1) 
ij —10 1] 1) €; - O1 1106 1 0) 
i, (106 6) €; (1000101; 
ls (100 1) €,:(100111 0) 
hig . (] 0 1 ()) Cio =(7 07 0 6 1 s 
£,17(101 1j €; —11011009) 
"TP (116 ()) €j:5—-(11000 1 0j 
£47 (110 1) €3-:(110100 1j; 
4701190) C€j4:(11101 090) 
lis z(111 1) €14 — (1 E211] lj 


MM "MINIM 


At the decoding stage the received word is 


V = (Vi, V2, V3, Va, Vs, V6, v7) 


where 
y= í 
vcl, 
¥3 = 13 
V4 = 14 
ys = py 
V6 = p2 
LESE p3 


if no errors occur. The decoder determines 3 parity-check sums 


sy — (vi + V2 + V3) + vs 
$2 = (v2 + V3 + V4) + vg (1.19) 
$3 = (V +v + V4) + v3. 


The first 3 bits in each parity-check sum correspond to the same combination of 
information bits as that used in the construction of the parity bits (see eqns 1.17), 
they are enclosed in parenthesis to emphasize this correspondence. From the parity- 
check sums we can define 


S = (51,52, 53) (1.20) 





UCM c: 


24 Biok codes 


which is known as the error syndrome or syndrome of y. The parity-checi Y 
constructed such that they are zero if no errors occur. For example if Sian, ate 
errors then there ace 


y 
fe P - 
T - » ifs ~~ F4 —— ^5 
; å S — | i . —- 
Ê $j 5 j È 3j "Pp: 
E 


and using eqns 1.17 gives 


5; = p; +p; =0. 


Note that p; + p, = 9 irrespective of whether P; i$ 9 or Í (because WE are ne 

modulo-2 addition). Likewise we can show that s; — 5; = 0 when there are no erron 

Therefore the error syndrome s = (00 0) when there are no errors. Consider now s. 
i (1 f «4 mcr 2 : - 

codeword cs; = (101 10007. if it incurs no errors then it will give F=(191 10 G9, 

as the decoder input and the resulting parity-check sums will be | 


s = (0+1+1;+0=0 
s=(1-~-O0+1])+9=-—9 


which again given s —(0 0 0). Likewise if we take any codeword from Table 16 
the error syndrome s = (0 0 0) and so the error syndrome of a codeword is always 
zero. The construction of the parity-check bits and parity-check sums is such that 
the error syndrome of an y codeword is zero. 


Example 1.9 

Let c-—(011101 0) bea codeword sent over a channel. If no errors occur 
then the received word is y=e-=(0 11101] 0) and using eqns 1.19 gives the 
parity-check sums 


s: = (9+1+1)+0=9 
ss=(1+1+-J])+-1=9 
$:—(0—1—1;,—0-29 


— 


giving an error syndrome of s = ( $1.53. 53) = (0 0 0). - 

A zero error syndrome is always obtained when there are no errors and a nonzere 
error syndrome can only arise if errors have occurred. However. the occurrence of 
errors does not necessarily give a nonzero error syndrome. as a zero error syndrome 
is also obtained whenever an error pattern changes a codeword into a differen! 
codeword. For example. if the codeword es —(0101 1 00)incurstheerrore=(0! 3 
0 0 1j then. using eqn 1.1. the decoder input is : 





r=c+e | 1.3 
—(0101100)—(011000 1) 
—(0011101) 
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which is the codeword ey. The resulting parity-check sums are 


$ = (0+0+1)+1=0 
5=(0+1+4+1)+0=0 
33 2 (0+0+1)4+1=0 


giving $= (0 0 0) and therefore the error pattern is undetectable, The occurrence 
of a single error gives an error syndrome s that depends uniquely on the position 
of the error within the codeword, Furthermore s is independent of the code- 
word incurring the error because the error syndrome of a codeword is always zero. 
For example consider the codeword ¢)5 = (1 1000 10) incurring the error pattern 
e-- (0001000) this gives 


v=c+e 
=(1100010)+(0001000) 
=(1101010) 


and the parity-check sums are 


$ = (14+1+0)+0=0 
s=(1+04+ 1) +1 =1 
$3 =(1+1+1)+0= 


giving s=(0 1 1). Consider now some other codeword, say, c4 (0 01 1 10 1) 
incurring the same error pattern e — (000 1 000), here v - (00 10 LO I) and again 
we get s = (01 1). Any of the 16 codewords, belonging to the (7, 4) code, incurring the 
error e — (000 1 000) will give the error syndrome s = (0 1 1). Table 1.7 shows the 7 
different single errors e that can occur in a 7-bit word, along with their corre- 
sponding error syndromes s. The error syndrome s — (0 0 0), obtained when no 
errors occur, is included in the table. The table can be used for single-error correction 
by ‘looking up’ the error pattern e corresponding to a given error syndrome s. The 
position of the nonzero bit in e gives the position of the error in v, and on locating the 
error the erroneous bit is corrected by inverting it. Table 1.7 is referred to as a 


syndrome table. Note that the error pattern obtained from the syndrome table and 


Table 1.7 
Syndrome table for the (7, 4) Hamming code 
Error pattern e Error syndrome s 
(ei ; 05, Cy, Cg, C5, C6 e7) (51, S2, $1) 
(0000000) (0 0 0) 
(0000001) (0 0 1) 
(000001 0) (0 1 0) 
(0000100) (1 0 0) 
(0001000) (0 1 1) 
(0010000) (1 1 0) 
(0100000) (11 1) 
(1000000) (10 1) 


al 
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ord are the decoder's guess or estimate of the error 


^ > : d 
i are denoted by é and é respectively. Decoding can tern 


the resulting codew 
Pe sun, 


and codeword c anc 
marized in the three steps: 

ate s from the decoder input v. 

able obtain the error pattern e that corresponds to , 


The required codeword is then given by € = Y +e, this has the effect of iny 
the bit in v given by the position of the nonzero bit in ê. 
In the event of a single error occurring, the resulting error syndrome gives the ary 


error pattern and the correct codeword is obtained. All single errors can be corrected 
and therefore the (7, 4) Hamming code is a single-error-correcting code. 


|. Calcul 
2, From the syndrome t 
4. i 


Example 1.10 l 
Given that a codeword c, of the (7,4) Hamming code, incurs a single error $0 


giving r-(10110 0 1), find c. 

Using eqns 1.19 gives the parity-check sums 
s seils041) 4020 
$3 


s= [D 13-1] -0 0 
s (404-1) 121 


| 


and so the error syndrome s = (5), 52, 53) = (0 0 1). From Table 1.7, s = (0 0 1) gives 
the error pattern (0 0 0 0 0 0 1). Inverting the right-hand bit of v gives (10 1 1000) 
which is the codeword c. g 


The syndrome table for the (7,4) code contains all possible values of s= 
(s1, 52,53), so whenever two or more errors occur the resulting error syndrome s 
will always be one that corresponds to no errors (s = 0) or to a single error (s # 0), and 
on both occasions a decoding error occurs. There are no decoding failures and 
therefore decoding is complete. For example consider co — (10 0 1 1 1 0), along with 
the double-error pattern e = (00 1 00 1 0), so giving v—co--e— (1011100) The 
error syndrome of v is s = (1 0 0), and referring to Table 1.7 we get ê= (0000100) 
Hence é— v -é— (101 1000) which is c}; and not cg. Whilst the two errors have 
been detected (because s #0), a decoding error has ultimately occurred. All double 
errors give a nonzero syndrome and are therefore detectable. We have already seen 
that the code can detect and correct single errors, and therefore the (7,4) Hamming 
code can detect single and double errors or can correct single errors. Note that 
although the code can detect up to 2 errors, this is only interpreted as error detection 
i error correction is not implemented. If error correction is carried out then decoding 
: viewed asa correction, and not a detection, process. Hence it is in this sense that we 
opa ieri n able to detect up to two errors or correct single errors. -" 
paver naan ires in me. carrying out error detection and correction, for th 

We have seen ibe "x erp capability (see Section 1.7). doubk 
errors, however athe: = (7,4) code is guaranteed to detect all single and p : 
errors and 4-bit errors B ihe pound — M ; 

e detectable as shown in the example below. 
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Example 1.11 
Given that the (7, 4) code is used for error detection only, determine the outcome 
when the codeword e, — (0 1 1000 1) incurs: 
(a) the triple error e; —(0101100) 
(b) the triple error e—(10010 10). 
(c) the 4-bit error e (1110100) 
(d) the 4-bit error e,—(010110 1). 


(a) Ires = (011000 Dincurstheerrore; 260101100) thenr— cg ei 2 (00111 
0 1). The parity-check sums are s, = 0, 5, — 0, and s, = 0, and so $ = (5). 8.53) = 
(0 0 0). The erroris therefore not detected and so a decoding error has occurred. 

(b) When cg incurs the errore; =(1 001010) we get r=(1 11101 D). The error 
syndrome is now s=(1 0 0) and so the error has been detected. 


(c) Foresandes v 2 (100010 D) and theerror syndrome s = (000). The four errors 
are not detected. 


(d) Here cq and e, give v — (00 1 1 1 00) and error syndrome s= (0 0 1). The four 
errors are therefore detected. 


Note that the triple-error pattern e, and the 4-bit error pattern e; are undetected 
because they are identical to the codewords c; and c,, respectively. The other two error 
patterns do not resemble any of the codewords and are therefore detectable. CL] 


The (7, 4) Hamming code is the first code in the class of single-error-correcting 
codes whose blocklengths n and information lengths k satisfy 


—r (1.21) 


for any integer r3, and where r=n—k gives the number of parity-check bits. 
Taking r — 3 gives the (7,4) code already considered. For r —4 we get the (15,11) 
Hamming code which has 11-bit information words, 15-bit codewords and 4 
parity-check bits. Given the information word i= (ij, i». . .., i11) the parity bits are 


Ppi =i +i +i, + i4 + ię + ig + ig 


P2 =h +i} tig t+ is +17 + Ig + ijo 
xU E. l3 ! impr 
p3 dc dac ds dg ig d iio +i 


Pa=U+thtatistiptigt iy 


so giving the codeword c = (i), i2,.... i11, P1, P2, P3, Pa). The parity-check sums and 
syndrome table are constructed in the same way as those for the (7, 4) code. 
Table 1.8 shows the number of codewords and error syndromes for the (2° — 1, 
2 — l — r) Hamming codes for values of r = 3, 4, 5 and 6. Note that the number of 
error syndromes rises much less rapidly with r than the number of codewords. Error 
detection and correction can be achieved through the use of tables of codewords, but 
this becomes impractical for large values of n and k. Decoding based on a syndrome 
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Table 1.8 

The Hamming codes for r=3 to 6 
At AO Number of Number of 
2 codewords syndromes 
ia, 
3 (7,4) 16 8 | 
4 (15,11) 2,048 16 
5 (31, 26) = 67 x 10° 32 
- d^ 17 
6 (63, 57) ~10 64 
r [2^ 1,2" — 1 — p) 2^ r 
Where k = 7 — 1 - r. 


table is usually a practical alternative, due to the number of error syndromes being 
significantly less than the number of codewords. 

An additional parity-check bit can be added to the (7,4) code to give 8-bit 
codewords with even parity. The resulting code is known as the (8, 4) extended 
Hamming code and is capable of jointly correcting single errors and detecting double 
errors (see Section 2.7), 

The use of a syndrome table for error correction is not restricted to the Hamming 
codes but can be applied to any block code. The syndrome table consists of all 
correctable error patterns along with their corresponding error syndromes. An (n, k) 
single-error-correcting code has "C, =n single-error patterns and corresponding 
error syndromes in its syndrome table. A double-error-correcting code has "C, 
single-error patterns and "C, double-error patterns and error syndromes, in its 


m~ . . n 
syndrome table. A code capable of correcting t errors requires "C,, "C», ..., "C,error 
patterns and error syndromes. 


1.7 Minimum distance of block codes 


In Section 1.2 we introduced the idea of parity-check bits having the effect of adding 
redundancy and so producing codewords that are separated from each other. 
Increasing the parity-check bits increases the redundancy and the separation Or 
distance between codewords. Here we extend these ideas further and consider how 
distance between codewords determines the error-control capability of a code. As 
we shall see the concept of distance between codewords, and in particular the 


o error-control codes. 
The Hamming weight or weight of a word v is defined as the number of nonzero 


two words vı and vp, having the same number of bits, is defined as the number of 
places in which they differ and is denoted by d(vi, v2). For example the words v»; = 


(011010)and»,— (101000) have weights 3 and 2 respectively and are separ ated 
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by asliitance ol 4, therefore 


W(OTLOP GO) = 4 
W(LOLOOO) =2 


Se 


d 11010, [01000 3, 


| hec mininin distance inin ol i block eode 1% the snmiallest distance hel weet code 
words, Hence codewords differ by du or more bits, The minimum distance is found 
by ark ving id pnt ol codewords, determining the distiunce between ihein and then 


repeating this For all pain of different codewords, The smallest value obtained is the 
minimam distuncece of the code 


lxample 1.12 


Determine the minimum distance of the eveneparily (3,2) block code. 


Here the codewords are (0 0 0) , (01 1), (E 10) and (F0 1), Taking codewords 

parrwise gives 
(0 0.0, 0 | 1j 
d(0 0 0, 110) 
(0 0 0, 10 1) 
d(O | 1, 1 1 0) 
d(0 1 1, LOI) 
MV 10, 10 1) 


ho 


and the manimmum distance of the code is therefore 2, = 

Consider the (7,4) Hamming code whose 16 codewords are shown in Table 1.6. 
This has 120 pairs of different codewords, and it can be shown that any pair of 
codewords has its 2 codewords separated by a distance of 3,4 or 7 and therefore the 
minimum distance of the (7,4) Hamming code is 3, The code has 4 pairs of code- 
words where the 2 codewords in each pair are separated by a distance of 7, 56 pairs 
have their 2 codewords separated by a distance of 4 and the remaining 56 pairs have 
codewords separated by a distance of 3 (see Table 1,9), 

His not usually practical to determine the minimum distance of a code by con- 
sidering the distance between all pairs of different codewords, An (n, k) block code 
has m 2" codewords and therefore "C; different pairs of codewords, a term that 
nes very rapidly with increasing k. The (7,4) Hamming code has 120 pairs of dif- 
lerent codewords, and the (15,11) Hamming code (see Table 1.4, r= 4) has 2°! 
codewords which gives over 2 x 10° pairs of codewords, An arbitrary block code 
could require a considerable degree of computation to determine its minimum 
distance, However, the codes that are important are not arbitrary but have a linear 
property (already referred to at the start of Section 1.6) that allows the minimum 
distance to be determined easily, this is considered in Section 2.1. 

It is interesting to consider a block code from a geometric point of view, as this 
helps to illustrate the concept of distance between words, Codewords belonging to 
an (n, k) block code can be thought of as lying within an n-dimensiona! space 


i 
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Table 1.9 
Distance between codewords in the (7, 4) code 

Co  €| €) C3 C4 Cs Ce C7 CR CQ Cio Cil S 
o 0 3 3 4 4 3 3 4 3 4 4 3 3 4 4— 
a 3 0 4 3 3 4 4 3 4 3 3 4 4 3 , 7 
cQ 3 4 0 3 3 4 4 3 4 3 3 4 4 7 4 § 
e 4 3 3 0 4 3 3 4 3 4 4 3 7 4 4 
q 43 3 403 3 4 3 4 4 7 3 4 4 | 
C5 3 4 4 3 3 0 4 3 4 3 7 4 4 3 3 4 
& ¢ 4 4 Fp & OS 4 7 304 O 3 | 
é& 4 d 3 4 4 $ 8 0. 74.45.3..59. 4 4 4 
co 3 4 4 3 3 4 4 7 03 3 4 A4 3 3 | 
co 4 3 3 4 4 3 7 4 3 0 4 3 3 4 4 4 
co 4 3 3 4 4 7 3 4 3 4 0 3 3 4 4 3 
cu 3 4 4 3 7 4 4 3 4 3 3 0 4 3 3 4 
eo &@ 4 4 7 34 4 3 4 3 3 4». Db. 3 3 g 
c3 4 3 7 4 4 3 3 4 3 4 4 3 3 0 4 3 
as 7 4 4 3 3 4 4 3 4 3 3 4 4 3 3 9 


(1 dimension for each bit). For example Fig. 1.9 shows the (3, 2) even-parity code ina 
3-dimensional space. Each codeword is of the form c = (cx, Cy, €z) where cx, cy, and c, 
are 0 or | and are the coordinates of c along the X, Y, and Z axes respectively. The 
shaded circles are codewords and the open circles show words that are redundant to 
the code. Each codeword has 3 redundant words a distance 1 away from the code- 
word and is at a distance of 2 away from the other 3 codewords (the dotted lines 
represent a distance of 1 within the space). A codeword incurring a single error will 
result in a ‘transition’, along a dotted line, to a redundant word. A second error will 
give another transition, this time to 1 of 2 codewords. For example, say (1 0 1) incurs 
a single error to give (0 0 1), then a second error will then give the codeword (0 1 1) 
or (0 0 0). A minimum of 2 errors/transitions are required to change any one 
codeword into another codeword, which is consistent with the code's minimum 
distance of 2. 

The distance within a code can be illustrated without reference to a coordinate 
system, as shown in Fig. 1.10(a). This shows the main features of the (3, 2) code seen 
in Fig. 1.9, namely that each codeword is connected to 3 redundant words and a 
minimum of 2 transitions are required to change any one codeword into another. 
Figure 1.10(b) shows the corresponding diagram for the (3, 1) repetition code. Here 
there are only 2 codewords (0 0 0) and (1 1 1). To get from either of the codewords to 
the other requires 3 transitions and the minimum distance of the code is therefore 3. 
This is a rather obvious result because comparing (0 0 0) to (1 1 1) gives dmin = 
immediately, nevertheless it is always interesting to view a code in this manner. 

If we attempt to produce a similar diagram for the (7, 4) code we find that it soon 
becomes rather cluttered. Whilst there are only 16 codewords, the total number 0 
words is 128 each of which has to be linked to 7 other words (one link for eac 
transition). A further simplification to Fig. 1.9 is to show words along one dimen- 
sion only, as shown in Fig. 1.11. Each site no longer represents a specific word, DU 


Paes 
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(001) (011) 
C e 
(111) 
(101) @ O 
(000) @ bon Ó “ 
(010) y 
(100) © . e 
" ad (110) 
€ Codewords 
m © Redundant worda 


Vig. 1.9 The (3, 2) code in a 3-dimensional space, 


only whether or not it is a codeword (shaded and open circles represent codewords 
and redundant words respectively). Moving from one circle to an adjacent circle 
represents a change of 1 bit (Le. a distance of 1), The codewords c; and e» are 
separated by a distance 3, and ej and ej by a distance of 2, five redundant words r, 
lors are shown, 

Consider now the arrangement of codewords shown in Fig. 1.12(a), this typifies 
the separation of words in a code with minimum distance 3, Here A and B indi- 
cate examples of transitions that can occur if e, incurs 1 or 2 errors respec- 
lively, Examples C and D show triple errors occurring at c» and c, respectively. To 
determine the decoding decisions for the errors A, B, C, and D we consider a 
maximum-likelihood decoder with input v. For a binary-symmetric channel, max- 
imum-likelihood decoding is equivalent to selecting a codeword that is closest to v 
than any other codeword and is referred to as minimum-distance decoding or nearest- 
neighbour decoding. The error patterns in Fig. 1.12(a) will therefore be decoded as 
follows: 


A: c, incurs a single error 
The error is detected because it gives a redundant word rz. Furthermore, minimum- 
distance decoding is able to correct the error as r3 lies closer to e, than c». 


: €; incurs a double error 


The error is again detected, however this time the redundant word r; lies closer to c; 
than e; and minimum-distance decoding estimates ¢ to be the required codeword, 
This will give a decoding error. 
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(a) The (3,2) even-parity code 


ee 


110 fo 100 001 L1 644 


(b) The (3,1) repetition code 


[ocu codewords po | redundant words 


Fig. 1.10 Illustrating distance. 


C: c» incurs a triple error 


The error changes c; into c4 and cannot be detected or corrected. Again this will give 
a decoding error. 


D: c4 incurs a triple error 


Here the number of errors equals the minimum distance of the code but a redundant 
word rę is still obtained as c3 and c4 are separated by a distance of 4. The error 5 
therefore detected but a decoding error occurs as c5 is the nearest codeword to re- 
Ina code with dmin = 3 the occurrence of single or double errors within acodeword 
always gives a redundant word (asin A and Babove) and the detection of the errors 5 
guaranteed. The occurrence of 3 or more errors may be detected (e.g. D above) but 
not all such error patterns are detectable (e.g. C above). Hence a block code with 
minimum distance 3 can detect all single and double errors. A code with minimum 
distance 5 can detect 4 or fewer errors, as illustrated by A, B, C and D in Fig. 1.120} 
E shows an undetectable 5-bit error. A code with minimum distance 7 can detect 6 


——— 
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1-bit transition 2-bit transition 
£ C, i fy c [a es ts 
Fig. 1.11 A simplified way of illustrating distance. 
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Fig. 1.12 Examples of errors. 


fewer errors. It follows that a block code with minimum distance din Can detect all 
error patterns with 


or fewer errors. 

An error pattern incurred by a codeword c is correctable only if the resulting 
redundant word is closer to ¢ than any other codeword. For a code with din = 3 itis 
only single errors that satisfy this requirement Hence a block code with minimum 
distance 3 can correct all single errors. A code with minimum distance 5 can correct 
all single and double errors, a codeword c incurring a single or double error wil! give 
a redundant word that is closer to c than any other codeword. A code with minimum 
distance 7 can correct 3 or fewer errors and it follows that a block code with mini- 
mum distance d, can correct all error patterns with 


t = dain — 1) (1.24) 


or fewer errors. 

We refer to t and f as the error-correction and error-detection limits respectively 
and they give the error-control limits of a code. Codes with error-correction limit 
‘ and error-detection limit / are referred to as f-error-correcting codes and 
f "error-detecting codes respectively. Note that whilst a code with error-detection 
limit / is guaranteed to detect alll error patterns with / errors or less, the code will also 
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be able to detect some error patterns with more than / errors. Likewise ar 
correcting code is able to correct certain error patterns with more than ; errors, We 
will return to this in Section 2.6. 

Let's now return to the notion that codewords of an (n, k) code lie wi 
n-dimensional space. Each codeword can be thought of as having a decoding 
or radius ¢ around it. Each decoding sphere contains redundant words tha 
distance of t or less away from the codeword at the centre of the sphere. There wi) 
usually be redundant words lying outside the decoding spheres but no word will 
belong to two or more spheres as the spheres are non-intersecting. In a minimum. 
distance decoder with input v the codeword at the centre of the decoding Sphere 
within which v lies is taken as the required codeword. If every word within the Space 
belongs to one and only one sphere, so that no word lies outside a decoding Sphere, 
and the spheres are of equal radius, then the code is referred to as a perfect code. The 
word ‘perfect’ is used here not in the sense of the best or exceptionally good, but 
rather to describe the geometrical characteristic of the code. The decoding spheres 
can be thought of as perfectly fitting the available space with no overlap and no 
unused space. The Hamming codes and the repetition codes with odd blocklength 
are perfect codes, however perfect codes are rare. 

Whilst eqns 1.23 and 1.24 represent a code's inherent error-control capability, 
often the error control realized is a compromise between error correction and error 
detection. We have already seen that the (7, 4) code can correct single errors or detect 
up to 2 errors. When double errors occur they are detected, because the error syn- 
drome is nonzero, but subsequently ‘corrected’. The decoding process is not so much 
one of double-error detection, which would result in a decoding failure, but rather 
error correction resulting in a decoding error. When carrying out single-error cor- 
rection the double-error detection capability of the code is not used. However, if the 
decoder does not carry out single-error correction then double errors give a decoding 
failure and are said to be detected. The (7, 4) code, or any other code with din = 3, 
cannot carry out double-error detection and single-error correction jointly. To do so 
requires a larger minimum distance and it can be shown that a block code with 


minimum distance d,,;, can jointly correct ¢’ or fewer errors and detect /' or fewer 
errors providing 


"CrTOf. 


8 Sphere 
tare at a 


PAL Edda —1 (1.25) 


where /' > f’. Table 1.10 shows values of r’ and / that satisfy eqn 1.25 for minimum 
distances of 1 to 7. Note that for each value of r’ the value of / shown gives the 
maximum number of errors that can be detected excluding error patterns with /’ or 
fewer errors. For example for dmin = 5 and f’ = 1 we get f’ = 3 which means that all 
double and triple errors can be detected. Likewise for dmi — 7 and r —2, which 
give /" = 4, all triple and 4-bit errors can be detected. Note also that for odd values of 
dmin €rror detection is not possible when the maximum number of errors are cor- 
rected. Whereas when dmin is even then dmin/2 errors can be detected when the 
maximum number of errors, now given by (dyin — 2)/2, are corrected. 

The four ways of using the error-control capability of a code with dyin = 7 are 
illustrated in Fig. 1.13. Two codewords c, and cp, separated by a distance of 7, are 
shown along with six redundant words r, to re and we consider c, incurring 6 or 
fewer errors. In Fig. 1.13(a) the decoder is correcting the maximum number of errors 
3 and so decoding spheres of radius // = 1 — 3 are shown around c, and c2. Single, 
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Table 1.10 
Joint error correction and detection 


dmin Number of errors Number of errors 


corrected t' detected /"' 
1 0 0 
2 0 1 
3 | 0 
or 0 2 
4 ] 2 
or 0 3 
5 2 0 
or 1 3 
or 0 4 
6 2 3 
or 1 4 
or O 5 
7 3 0 
or 2 4 
or 1 5 
or 0 6 


double, and triple errors incurred by c, result in redundant words lying within c;'s 
decoding sphere and the errors are correctable. There is no error detection capability 
because error patterns with 4, 5, or 6 errors give words lying within c?'s decoding 
sphere and will therefore give decoding errors. Figure 1.13(b) illustrates decoding 
when only 2 errors are corrected (f = 2). Each decoding sphere now has a radius of 
2 and the redundant words r, and r4 are excluded from both spheres. Single and 
double errors can still be corrected, however 3- and 4-bit errors lie outside c,’s 
and c;'s decoding spheres and cannot be corrected. This is therefore an example of 
l- and 2-bit error correction, jointly with 3- and 4-bit error detection. Reducing '' to 
| gives r2, r3, ra, and rs lying outside the decoding spheres (Fig. 1.13(c)). This allows 
single-error-correction and the detection of 2, 3, 4, and 5 errors to take place 
jointly. If no error correction is implemented (t — 0), then there are no decoding 
spheres and 1 to 6 errors can be detected (Fig. 1.13(d)). 


1.8 Soft-decision decoding 





In the preceding sections it has been assumed that the output of the demodulator (see 
Fig. 1.1) isalways a 0 or a 1. Such a demodulator is said to make hard decisions. A 
demodulator that is not constrained to return 0 or | but is allowed to return a third 
symbol, say X, is said to make soft decisions. A soft decision is made whenever the 
demodulator input is so noisy that a 0 and 1 are equiprobable. The symbol X 
is referred to as an erasure and Fig. 1.14 shows a channel that includes erasures. 
An erasure is treated as an error whose location is known but with unknown 
magnitude and is thought of as being at a distance of 1/2 away from 0 and from 1 
(i.e. equidistant from 0 and 1). A demodulator that makes hard decisions gives no 
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Fig. 1.13 Joint error correction and detection for dmin = 7. 


indication of the quality of the 0s and 1s entering the decoder. The decoder makes 


decisions on the presence or absence of errors according to the error-control co ^ 
being used. A soft-decision demodulator, however, provides the decoder - : 
additional information that can be used to improve error control. In the event eM 
decoder detecting errors, any erasures in the word being decoded will be the bits 

are most likely to be in error. 
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Fig. 1.14 An erasure channel. 


Table 1.11 
Error and erasure 
correction for d,,;, — 10 


AF 


4A U€KN—CO 
=v anoa 


Consider the (8, 7) even-parity code and let's assume that the input to the decoder 
is»=(1 0010100). The parity of v is odd and therefore the decoder knows that at 
least 1 error has occurred. Based on the parity of v alone the decoder has no way of 
establishing the position of the error, or errors, in v. Consider now a decoder whose 
input is taken from a soft-decision demodulator and let v 2 (01 1 10 X 1 1) be the 
decoder input. The parity of v is incorrect but here it is reasonable to assume that the 
position of the erasure gives the bit that is most likely to be in error. If the erasure is 
assumed to have a 0 value then v still has the wrong parity. However setting X = 1 
gives » (01 1 101 1 1) which has the correct parity and can be taken as the most 
likely even-parity codeword that v corresponds to. If v has the correct parity and 
contains an erasure, then the erasure is set to 0 or | as so to preserve the correct 
parity, for example given v = (1 X000100) we would set X = 0. If v contains a single 
erasure, and no other errors, then single-error correction is guaranteed. The (8, 7) 
even-parity code is an error-detecting code, it has no error-correcting capability. 
However, here we see that in conjunction with a soft-decision demodulator single- 
error correction can be achieved. The combination of error-control coding with soft- 
decision demodulation is referred to as soft-decision decoding. 

It can be shown that for a code with minimum distance dj any pattern of r’ errors 


and s' erasures can be corrected providing 


Sf 43 < uus = T (1.26) 


Table 1.11 shows values of r and s’ for dmin = 10. Note that, because erasures and 
errors are respectively at a distance of 1/2 and 1 from the correct value, for every 
extra bit corrected the number of erasures that can be corrected is reduced by 2. The 
(8,7) even-parity code has dmin =2 and 1— 0 therefore only | erasure can be cor- 
rected. The (7, 4) code, with dmin = 3, cannot correct erasures when used for error 
correction, but can correct up to 2 erasures if error correction is not carried out. 
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We have seen that there are benefits to be gained by using Soft-decision demo. 
dulators that are not constrained to return Ò or 1 but can return erasures, Furthe 
benefits can be mained Using demodulators that can assign a hit quality to each bit 
Here the demodulator decides whether each hit is a Oor Land assign a bit Quality that 
indicates how good each bit is. A bit that isa clear-cut Oor 1 would be assigned a high 
bit quality, whilst à bit that is only just à O or lis given a low bit quality. In the Case 
where a bit is equally likely to be a O ora I then an erasure is returned, The decoder 
then makes tts decision not just on the basis of the bit values, O, 1, or Y, but also on 
the quality associated with each bit, The use of bit-quality information can give 
considerable coding gains, but is at the expense of increased complexity for both the 
demodulator and the decoder, 


1.9 Automatic-repeat-request schemes 


lhe communication channel that we have considered so far is one in which infor- 
mation transfer takes place in one direction only, namely from the point at which 
Information is generated to the point at which the information is used (see Fig. 1.1), 
Lrror-control encoding takes place prior to transmission, and on reception of 
the information, decoding takes place with à view to detecting, and if possible 
correcting, any errors incurred during the transmission. The direction of informa- 
tion transfer from the source to the user is referred to as the forward path and the 
error-correction techniques previously considered are known as forward-error- 
correction schemes, A channel within which transmission is possible from the user to 
the source is said to have a return path. The existence ofa return path allows requests 
to be made for retransmission of information in the event of a decoding failure. 
Strategies of error control based on requests for retransmission are referred to as 
Automatic- Repeat- Request (ARQ) schemes. 

Figure 1.1S(a) shows one of the simplest ARQ schemes, namely a stop-and-wait 
scheme. Here the transmitter sends a word w, on the forward path, and waits for an 
acknowledgement (ACK) on the return path before sending the next word wp. If 
the decoder at the receiver detects no errors in w, then the receiver sends an 4CK to 
the transmitter. The transmitter, upon receipt of the 4CK transmits the next word 
wy However, if w, is found to contain errors then the receiver sends a negative 
acknowledgement (N ACK) reply, in which case the transmitter will retransmit wy 
instead of transmitting w>. Communication continues in this way with the trans- 
mitter waiting for a reply to each word sent, and sending a new word whenever the 
reply is an ACK and retransmitting the previous word if the reply isa NACK. Sucha 
stop-and-wait scheme is simple to implement but quite inefficient in terms of the 
usage of the communication channel, as the forward path lies idle whilst the 
transmitter waits for the 4CK/NACK replies. 

The go-back-N ARQ scheme, shown in Fig. 1.15(b) for N = 4, allows continuous 
transmission on the forward path, therefore avoiding idle transmission time. Here 
the transmitter does not wait for an ACK to each word sent, but transmits COD 
tinuously until it receives a NACK. We assume, that because of delays within the 
system, that if the ith word sent by the transmitter is erroneous then the NACK 8 
received before the transmitter sends the (i+ N )th word. The receiver does not seni 
an ACK upon receipt of each error-free frame, but only sends a NACK whenever it 
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Fig. 1.15 Automatic-repeat-request schemes. 


reda an error. Furthermore the receiver discards the erroneous word and the 

~ | words that follow. The transmitter, upon receipt of a NACK goes back N 
Words and retransmits the ith word along with the N — 1 words that followed. By 
respectively disca 


; rding and retransmitting N words the receiver and the transmitter 
nsure that the correct sequence of words is 
In Fig. 1.15(b) ws 


preserved, without the receiver having to 
Store words. 


is in error and so the receiver replies with a NACK. 
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On receipt of the NACK the transmitter interrupts the 
retransmits ws, instead of ws, after which it continues with 

If the receiver is capable of storing words, then the go-back. A «, Th 
improved by retransmitting only words that are erroneous "me Cat he 
detecting an erroneous word discards the word, sends a NA CK to " j Eier, tn 
and stores the N — ] words that follow. The transmitter, on receipt ef At Hit 
retransmits only the erroneous word. On receiving the retransmitted NACK 
receiver uses the N — 1 words stored to reconstruct the correct sauene M l f 
Such a scheme is known as a selective-repeat ARQ scheme (see Fi g. Lisle : wong, 
emphasis for maintaining the correct sequence of words. in the ium. i 
occurring, is placed at the receiver. OT fft 


Sequerice gf Wed, 
fy ae ru aid s, 


Problems 


l.l A (4,3) single-parity-check code is used to generate even-parity codeword 
Determine expressions for the probability of. 


(1) correct decoding p, 
(11) a decoding error pe 
(iii) a decoding failure p; 


in terms of the bit-error probability p. Evaluate pe, pe, and py when p — 5» 16 * 
1.2 A single-parity check code has 8-bit codewords. Determine the maximum bit 


error probability that can be tolerated so that codewords have a success rate 
of 99.9%. 


1.3 An (n,n — 1) single-parity-check code is used for error detection in a channe 
with bit-error probability 1077. Find the maximum blocklength n such that 
the success rate does not fall below 9995. 


1.4 Given an (n, 1) repetition code determine the probability that an information 
bit is correct after decoding when n —3 and when n= 5. Assume 4 bit-errof 
probability of 0.05. 


1.5 A (4, 1) repetition code is used for single-error correction and dota 
detection. Find the decoding failure rate for a bit-error probability of 0.01. 


1.6 In a communication channel with bit-error probability 10^ an (n, I) 
repetition code is used for error correction. Find the minimum blocklen 
that gives a bit-error probability less than 1076 after decoding. Assume 
values of n only. | 


1.7 A product code is constructed from the (4,3) and (5,4) single-parity c^ 
codes. The information bits in the code arrays are denoted by ij n ipa | ^ 

where j— 1, 2, and 3. Show that the overall parity-check bit p 1$ te " 

whether it is constructed from the row parity-checks or from the 


parity-checks. Assume even parity. sity’ 


1.8 A (32,21) product code is constructed from the (8, 7) and (4, 3) singe P ay, 
check codes. Even parity is used to construct both the column and oi arta 
check bits. Figure 1.16 shows 4 arrays each of which represents 4 


Determine the decisions that a decoder is likely to make. 
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a) 1 0 0,1 6) O 1 0!!1 
1 1 110 1 0 110 
0 0 01!0 1 40» TEE 
1 0 110 t 09 110 
0 1 110 1 014 0! 0 
0 1 0 ! 7 0 0 01!0 
0 1 110 o 1 0 ! 4 
1 1 070 0 0 11!1 

c) O 1 110 (d 0 0 Oj}; 1 
1 0 0! o 1 0! 1 
1'45 010 0 1 0 !1 
0- 4 10 1 0 0! 1 
1 4 114 t=. 3 1! 0 
1 4 0!0 1 0 1!0 
1 14 114 o 1 1! 0 
TW ECL i: "7o tuus. E 
0 8g 17114 0 0 111 


Fig. 1.16 Arrays for Problem 1.8. 


1.9 Given that c=(1 00 1 1 1 0) is a codeword of the (7, 4) Hamming code 


1.10 


A 


determine the received word v, error syndrome s, the decoder’s estimate of 
the error pattern and estimate of the codeword when c incurs the error 
patterns 

(1) e; (0010000) 

(ii) e — (0 10100 0) 

(iii) e3 — (100010 1). 

Using the parity-check equations (eqns 1.22) for the (15, 11) Hamming code 
determine expressions for the parity-check sums sı, 52, 53, and s4 given 
y—(vjv5...,vis). Find the error syndrome s=(s,,52,53,54) for each 
different single-bit error in a 15-bit word. Hence construct the syndrome 
table for the (15, 11) Hamming code. 

Using the syndrome table for the (15, 11) Hamming code, constructed in 
Problem 1.10, find the codeword that each of the following words is most 
likely to represent 


1)», =(100010011001001) 
(ii) »52(0010011101001 10). 


Linear codes 






In Chapter | we considered some basic aspects of block codes, and the 
check codes. product codes, repetition codes and Hamming codes Ww 
It was stated that the Hamming codes were the first class of lin 


Single-parit 
ere introduced 

Car Codes to be 
devised for error control, and it is the linear property of codes that WE consider 
here. Whilst nonlinear codes do exist, by far most codes, and indeed th 


€ best codes, 
are linear. Linearity is an important structural property of codes, allowing 2 
concise representation of codes and the accompanying encoding and decoding 
rules. Of particular importance is the interpretation of linear codes 


in terms of 
vector spaces, but this is deferred until we meet vector spaces in Chapter 5. 


2.1 Definition of linear codes 


A blockcode is said to be a linear code if its codewords satisfy the condition that the 
sum of any two codewords gi 


ves another codeword. Hence, given the codewords ¢. 
and c; of a linear code, then 


Ci = C; — Cj (2.1) 
is also a codeword, where the com 


ponents of c; and c; are added together pairwise 
using modulo-2 addition. A linear code has the properties that 
i. The all-zero word (009... 0) is always a codeword. 


2. Given any three codewords c,, c; and c; such that 


ek = €j +t; 


then 


d(c;, ej) = wíc;,) 


that is, the distance between two codewords equals the weight of the sum of the 
codewords. 


3. The minimum distance of the code 
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The (7, 4) Hamming code considered in Section 1.6 is a linear code. Taking any 
air of codewords (see Table 1.6) we find that the sum modulo-2 is always another 
m deword. For example consider say c, and cio then 
€ +e —(0001011)-- (101001 I) 
— (1011000) 
= C. 


Likewise taking say c14 and c3 gives 


€j4 €3 — (1110100)--(001110 1) 
— (1101001) 
= €|3. 
Table 2.1 shows the sum of codewords, taken pairwise, belonging to the (7, 4) code. 
As a linear code, the (7, 4) code must have an all-zero codeword, and from Table 1.6 
we can see that this is so because co = (000 0000) is a codeword. If we take the sum 


of any two codewords, then the weight of the resulting codeword should equal the 


distance between the two codewords. Take for example c; and c;o, as shown above 
their sum is c,;. The weight of c, is 


w(cii) 2w(1011000)23 
and the distance between c, and c,9 is 
d(ci,ci) 2d(0001011,101001 1) 23 


as required. The minimum distance of a linear code is given by the weight of a 
nonzero codeword (or codewords) with smallest weight. Referring to Table 1.6 


Table 2.1 
Addition of codewords in the (7,4) linear code 

l— RA NEN ie ce calls IU NO Dali ób dissi cps a emis a U 
* € €) C€3 C€4 Cs C€6 Cj €g C€9 Ci Cn C2 €i Ci4 Cis 
RUP PRU NA PRG E E S RC lone I BIG TE oo dl one 2 RI 
C] Co C3 C2 Cs C4 C7 C6 C9 Cg €i Cio C€1? Ci2 Cis Ci4 
c2 C3 Co C] C6 C7 C4 C5 Cio Cil Cg C9 Cig Cis C12 C13 
€3 C C] Co C7 C6 . Cs C4 Ci} Cio C9 Cg Cis Ci4 Ci3 C12 
Cà Cs 6€6 C7 Co ey C2 C3 Cj C130 C€14 Cis Cg Co Cio Cil 
CS C4 €;  €& C . C9 €3 C C3 C2 Cis Ci4 C9 €g Ci Cio 
C6 €7 C4 Cs €?  €3 Co Cy Cra Cis C12 Ci5. Cio Ci C8 C9 
“7  €6  €5 C4 G €5 € Co Cis Ci4 €ji5 Ci2 CCQ C9 Cg 
“8 C9 Cio C C2 C3 Ci4 Cis Co C1. C2. €). C4 €5 Cg C 
Co Cg Ci) 


Cio «613 Ci2 Cis Ci4 CI Co C3 C2 C5 C4 C7 C6 
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we can see that all the nonzero codewords, apart from eas O IEE bY P), has 
weight or A There are no tongero codewords with weight lew than 3 and there. 
fore the mimmin distance of ihe (1, Àj code js 5 (iy we have alieady ER in 
Section F7) 

The single pariy-check. codes with even parity are also linear, Consider fui 
example, the codewords e, 7 (01 101010), 0, (001 101 00) and e, (f 
| O6) belonging to the O, 7) single party check code with even parity. The uim 
€; 6; (0 TOUT ILO) has even panty and is therefore s codeword, Lil és 
eq; eo (O11001 E O)ande,; es (QOL LE 000), which again have even párity 
and are therefore codewords Taking the sum of any 2 codewords belonging ló 
the 1, Ty even- parity code always gives an even parity word and therefore # code. 
word The (5, 7) even parity code is therefore nea 


bxample 2.1 


Consider the (4, 4) eyen- parity code with the # codewords 


(0 0 00j),(00 EF 1),(00 LO), 1090) 
pd dy, 0) N10), 0109 PRE I} I) 


Show that the eode is linear 


Taking the sum of the first nonzero codeword (001 1 with the other 7 codewords 
PIVES 


(00 1 1) 4 (09000, —- (001 I) 
(001 1j £ (0 110) — (0101) 
OOF 4100) — IID 
(00 FE 1) £ (0 10 1j) — (0 4 10) 
MOLI £(010160)—(100]) 
(OOS 1) 4 (1001) — (0101 0) 
(001 D) £ (111) (114100) 


all of which are even-parity words, The reader can verify that the remaining com- 


hinations also give. even-parity words, The (4,3) eyen-parity code is therefore 
linear. a 


Given that even-parity codes are linear, we might expect that odd-parity codes are 
also linear, However, this is not so because the sum of any two odd-parity words 
gives an even: parWy word, Consider for example the codewords (0 0 0 0 0 100) and 
(101900001) belonging to the (4, 7) odd-parity code, The sum of the two codewords 
is (10100101) which has even parity and therefore is nota codeword, Furthermore 


note that the all-zero word has even parity and therefore odd-paríty codes cannot 
be linear as the all-zero word is not a codeword, 


Example 2.2 


Show that the sum of any 2 codewords from the (4, 3) odd-parity code fails to give? 
codeword, | 
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The codewords are 


(0.0 0 1), (00 1 0),(0 100), (1000) 
(0 111),(1 110),(10 1 D,(1101) 


and taking the sum of, say, (0 0 0 1) with the other 7 codewords gives 


(000 1)--(00 10) — (00 1 1) 
(000 1)-- (0100) — (0 10 1) 
(000 1)4- (1000) 2 (100 1) 
(000 1)4- (1 1 10) — (1 11 I) 
(0001)-- (1101) 2 (1100) 
(00 6 1)4- (101 1) 2 (LO 1 0) 
(000 1)-- (0 111) (0110) 


none of which have odd parity. The reader can verify that the remaining combi- 
nations also give even-parity words. The (4,3) odd-parity code is therefore not 
linear, unlike the (4, 3) even-parity code. C 


2.2 Generator matrices 


In Section 1.6 parity-check equations were used to generate codewords for the 
(7,4) Hamming code. Given an information word i= (i, iz, i5, i4) the parity-check 
bits pı, p», and p; are obtained using eqns 1.17 and then added to i to give the 
codeword c = (ij, i», i3, i4, Pi, P2, p3). A better approach to encoding is through the 
use of matrices and as we shall see, linear codes lend themselves naturally to a matrix 
representation. There is a unique correspondence between information words i and 


codewords c, which can be expressed as 
c — IG (2.2) 


where G is a matrix and is referred to as the generator matrix of the linear code. The 
generator matrix of an (n, k) linear code has k rows and n columns (note that a 
matrix with k rows and n columns is referred to as a 'k by m or k x n matrix and is 
known as the order of the matrix). The generator matrix for the (7, 4) code is a 4 by 


7 matrix given by 


G = (2:3) 


O = Q © 


0 
0 
0 
I 


— — me Cy) 
— CD = — 


| 
| 
| 
0 


O O =| © 


| 
0 
0 
0 


and later we shall see the relationship between the generator matrix and the code's 
parity-check equations. The product iG is determined by taking the product 
of i with every column in G. Each element in dis multiplied by the correspond- 
ing element in the column and then summed, using modulo-2 addition, over 
all elements. Consider i — (1 1 1 0), then using eqns 2.2 and 2.3 the corresponding 
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codeword c = (c1, €2, €3, C4, Cs, C6, c7) is given by 


1000 10, 
e= oo gy it 
0001044 


Multiplying i by the first (left-hand side) column of G gives the first p; 
It c, 


(1110) 1:12 1-04 1-04 0.01 


ooo r 
| 


and the second column gives c; 


(1110) 


1-0+1-14+1-04+0-0=1., 


oon © 


Likewise columns 3, 4, 5, and 6 give 1, 0, 1, and 0 for c3, c4, cs, and cg respectively, 
The last column gives c; 


(1110){ 0) =1-141-141-040-1=141=0 


and so c= (c1, C2, C3, C4, C5, C6, C7) =(1 1 1 010 0), which is the correct — 
for i—(1 1 1 0). Equation 2.2 can be used to generate all the 16 — 
belonging to the (7, 4) code. Note that when i = (0 0 0 0), eqn 2.2 gives c — (000 


. e b . f- 
0 0). Clearly the generator matrix provides a concise and convenient way of co 
structing codewords. 


Example 2.3 


Determine the set of codewords for the (6, 3) code with generator matrix 


| 1 (24) 
0 l|. 
] 0 


0... ., 1) 
We need to consider the information words (0 0 1), (0 1 0), (1 0 0),-- 
Substituting G and i= (0 0 1) into eqn 2.2 gives the codeword 


6, 
0 0 
0 1 
| ] 





100 0 T1 
c=(001)}0 10 1 0 1} =(001119) 
0 0-1^1:t 0 





o 
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Table 2.2 
The (6, 3) linear code 

i c 

(O O O) (0000090) 
(0 O 1) (001110) 
(0 1 0) (01010 1) 
(0 1 1) (01101 1) 
(1 0 0) (10001 1) 
(10 1) (101101) 
(11 0) (110110 
(11 1) (111000) 


— E Mtt 


and i — (0 1 0) gives the codewerd 


1000 1 I 
c—-(010)]0 1 0 1 0 I — (010101). 
0 0 1 1 1 D 


substituting the other 5 nonzero information words into eqn 2.2 gives the remaining 


5 nonzero codewords (the codeword for (0 0 0) is (0 0 0 0 0 0)). The resulting 8 
codewords are shown in Table 2.2. CJ 


Note that the codewords given by the generator matrices of the (7,4) and (6, 3) 
codes are in a systematic form, that is the information bits are placed together and 
are readily identifiable in each codeword. The reason for this lies in the way in which 


the generator matrices are constructed. The generator matrix for the (7, 4) code can 
be expressed as 


1 0 0 0 1 O | 
0 1 0 0 ] 1 1| 
We 0.0 1 0 1 1 O0 
0 0 0 I 0 1 1] 
that is a 4 by 4 identity matrix 
1000 
us 0 100 
* [00 1 0 
0 0 0 I 


augmented with a 4 by 3 matrix 


10 1 
jmi 3 
der ETE 
0 1 1 


known as the parity matrix. In terms of J, and P, the generator matrix G can be 
expressed as 


G = [I4|P]. 


i 


-— 
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The role of /4 is to keep the 4 information bits together and to position ther at One 
end of the codeword, so that the resulting codeword is systematic. The parity iatri 
P is responsible for the way in which the parity-check bits are constructed frorn 
the information bits. To illustrate this consider the codeword e for i= (i, j 


ts hy, i4} 
c= iG 
i; 000 1 0 |] 
— ct gas P UOS! lg id 
I (i1, i2, iz, l4) () () | () | | 0 
0 0 0 | 0 | | 
which gives 
€ = (its bsb la, pi, pa, pa) 
where 


pi = Oe + 1+ Blil:íiazi-h-i 
p= ltl: pt+0-b+ 1g = + i+ i4 


are the parity-check bits. The codeword c is in a systematic form and the parity- 
check bits are the same as those given previously by the parity-check equations for 
the (7, 4) Hamming code (see eqns 1.17). Each column in the parity matrix con- 


tributes one parity bit and determines how the parity bit is derived from the infor- 
mation bits. 


A generator matrix in the form 


G = |I, |P] (2.5) 


where J, is a k by k identity matrix and P is a k by n — k matrix, is said to be in a 
svstematic form asit generates systematic codewords. However, a generator matrix 
G may not necessarily be in a systematic form, in which case it generates a non- 
systematic code. If two generator matrices differ only by elementary row operations, 
that is by swapping any two rows or by adding any row to another row, then the 
matrices generate the same set of codewords and therefore the same code (there is à 
third row operation which is trivial here, see Section 5.5). If however two matrices 
differ by column permutations then the.codewords generated by the matrices will 
differ by the order in which bits occur. Two codes that differ only by a permutation 
of bits are said to be equivalent. Hence two generator matrices generate equivalent 
codes if the matrices are related by 


e column permutations 


e elementary row operations. 


The generator matrix of an (n, k) code is a k by n matrix (k rows and n columns) 
which in a systematic form is a k by k identity matrix augmented with a k by 4 -k 
parity matrix. The k by k identity matrix ensures that codewords are systematic, 
whilst each of the n — k columns of the parity matrix gives a parity-check bit. [t can 
be shown that every linear code is equivalent to a systematic linear code an 


— 
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e every nonsystematic generator matrix can be put into a systematic form by 
rmutations and elementary row operations. 


therefor 
column pe 


Example 2.4 
The (5, 3) linear code has generator matrix 


[10100 
G=/;0 100 I 
09 L1 1 i 9 


Determine the systematic form of G. 


In its systematic form G will be of the form G — [/|P], where Z is a 3 by 3 identity 
matrix and P is a 3 by 2 matrix. It is helpful to include a line in G showing where 
the matrix is augmented. To reduce G to its systematic form, we first add row 2 to 
row 3, so giving 


IU id 0 0 
G=/;0 1 0 0 | 
0 0 1 | 1 
and then add row 3 to row 1 to give 
100 l | 
G-—-|0 1 0 0 1 (2.6) 
0.0 1 | | 


which is the required systematic form. Table 2.3 shows the resulting systematic and 
nonsystematic codewords. E 


The codewords generated by a systematic and a nonsystematic generator matrix 
of a linear code differ only in the correspondence or mapping between information 
words and codewords. Consider, for example, the (5, 3) linear code with systematic 
and nonsystematic codewords shown in Table 2.3(a) and (b) respectively (see 
Example 2.4). Tables 2.3(a) and (b) have the same set of codewords but arranged 
in a different order. The tables differ only in the correspondence between infor- 
mation words į and codewords c. In both tables the correspondence between 


Table 2.3 
The (5, 3) linear code 





(a) Systematic codewords (b) Nonsystematic codewords 








i c i c 

(0 0 0) (U 0000) (0 0 0) (00000) 
(0 0 1) (0 0 1 1 1) (0 0-1) (01110) 
(0 1 0) (0 100 1) (0 1 0) (01001 
(1 0 0) (1001 1) (1 0 0) (10100) 
(0 1 1) (01110) (0 1 1) (00111) 
(1 0 1) (10100) (10 1) (11010) 
(1 1 0) (110 1 0) (11 0) (11101) 
(11 1) (12.404) "n 1) (10011) 





EE 
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information words and codewords is unique and therefore either Set of ¢ 

can be used to represent the information words. We can clearly see "s Ins Word 
code does not have just one generator matrix, but many matrices all or at a lineg 
equivalent and generate equivalent codes. The reader will find that fora Which ay, 
different generator matrices may be given in different text books. BIVEN code 
Example 2.5 

Given i = (ij, i2, 13, i4) determine the codewords for the (7, 4) code when 
and 3 of its generator matrix (eqn 2.3) are interchanged and (b) colum 
are interchanged. | 


(a) rows 2 
DS 5 and € 


(a) The generator matrix of the code is 


1^0 06 0 1. 9 ] 

DIDOIII] 
a= 00 10 1 1 0 

000 1 0 1 I 

and interchanging rows 2 and 3 gives 

1000 10 1 

0 0 10 1 1 O0 
u= 0 100 1 1 1 

000 10 1 1 


Taking i — (ij, i, i3, i4) gives the codeword 
c = iG = (ii, is, i2, ia, i + iz + i3, ih +13 + i4, i +i + a). 

In Section 1.6 codewords of the (7, 4) code were expressed as (ij, io, 13, i i1 t 
iz + is, iy + i3 + i4, i) + ip + i4). We see therefore that i, and i; have interchanged 
positions and the third parity bit of c is now given by i, 4- i4 4- i4 whereas 
previously it was i; + i? + i4. Nevertheless the set of codewords generated by G 
is the same as that previously obtained, except that there is a different cor 
respondence between the information words and codewords. Table 2.4 shows 
the codewords generated by G, and we can see that, for example, the code- 
word for i; — (0 1 0 1) is now c;=(0 0 1 1 1 0 1) instead of cs. Likewise the 
codeword for, say, ij; — (1 1 0 0) is now cio — (1 0 1 00 1 1) instead of ¢12 


(b) Interchanging colümns 5 and 6 in G gives codewords as 
C = (ii, i2, i3, la, i + i3 + i4, i +i +i, i +i + i4) 


and so this has had the effect of swapping the first and second parity a 


- | . ing 4 
The repetition codes are linear and therefore encoding can be achieved u$ 
generator matrix. An (n, 1) repetition code has generator matrix. 


G — (1101 1...1 1). 
For example the (3, 1) code has 


(2.1) 


G=(111) 


oe 





Generator matrices | 51 


i 


ig = (0 0 0 0) 
ij (0 0 O 1) 





and given / — i; the corresponding codeword is 


Table 2.4 
Nonsystematic codewords of the (7, 4) code 
Information words Codewords 
i c 





(00.0000 0) — cg 
(000101 1)=¢, 
(010011 =A 
(0101100)=e; 
(0010110)=e 
(001110 lee, 
(011000 1)=¢ 
(0111010)2-c 
(100010 1)=¢g 
(1001110)=e9 
(110001 0)=e)> 
(110 
(10.1 
(101 
(11 1 
(11 1 


c = iG = (i )(1 ] 1) = (i), 0), i) 


as required. The single-parity check codes, with even parity, are also linear and for an 
(n,k) single-parity-check code the systematic generator matrix consists of an I, 
identity matrix augmented with a single column with k rows all equal to 1, so that 


oo _ 
© 


0 0 0 


For example the (8, 7) even-parity code has 


1 0 0 0 
0 100 
00 1 0 
G=|0 0 0 I 
0000 
0000 
0000 


and s : . ES OR "x ue se nd 
O given i= (i » i5, 13, 14, l5, l6, i?) we get 


¢=1G= (i, i2, i5, ia, is, ie, Ì7, Ì1 +b th Td + is + ig + i) 


as required. 





O O -Oooo 


0 l 
0 l 
0 l 
l l 


D = 5 Oooo 
—ooocococo 
pb pó è jb ë p ë j ë pb pat 


(2.8) 


SS 
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When constructing codewords, using c = iG, the information word i 
ferent rows of G to form the codeword c. Each 1 in i contributes a row to ae 
consists of » ls then c will be made up of m rows of G added together using -— Ifi 
addition. The first (i.e. the left-hand side) bit of / determines whether the ts M 
G contributes to c, the second bit in ¢ determines if the second row contributes. of 
so forth. Consider for example the (7,4) code and let /— (0 0 0 | | the "-— 
codeword is ting 


Selects gir 


1000101 = 
0100111 | 

C-(000)!9 9 1 o 1 r of 7 (00901011) 
000101 I 


which is simply the bottom row of G. Likewise the codeword for i = (0 1 00) is simply 
the second row (0 1 00 1 1 1). If we now take i= (0 1 O 1) then the resulting code. 
word is constructed from the second and bottom row, so that c2 (0100111), 
(0001011)—(0101100). Taking every possible combination of the4 rows gives 
the 16 codewords belonging to the (7, 4) code. If we imagine the rows of G that are 
not required as being 'crossed out' then the required codeword can be obtained by 
going down each column of G and adding together the Is in the rows that are 
not crossed out. À note of the resulting sum is then made at the bottom of each 


column, and forms the required codeword. For example given i — (1 0 1 0) we can 
visualize the construction of c as 


(1010 [1.000 1 0 1 


c= 
— | 0—8——8—41-——9—-T— 
k dob dead 4d 
19 1809 ] ] 
which gives c — (101001 1). Likewise, say fori = (1 10 1) we can cross out the third 
row to get 
(1101)|1 00 O 1 0 1 
0 1 00 1 1 1 
> .|$9—0—1—9—1—1—9 
C 


— — © 
m -—— © 
oc © 
— <— pami 
oro 
or m 
— <— md 


which gives c — (1 101001). The construction of codewords by taking combina- 


tions of rows of G is reconsidered in Section 5.6 but this time in the context of vect^! 
spaces. 


2.3 The standard array 


ing à 
A scheme for error correction in any linear code can be easily developed — 
standard array of the code. For an (n, k) code the array consists of all 2" n-bit wo 


QUT 
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and the array 1s constructed such that for an n-bit word v the array gives the code- 
word that is the least distance away from v. Hence, the array can be used for 
minimum-distance decoding. A standard array for an (n, Kk) linear code is con- 


structed as follows: 
|. Place all the codewords in the first row, starting with the all-zero codeword. 


2. Take one of the remaining words w that has least weight and place it under the 
column containing the all-zero codeword. 


tjd 


. Fill in the row containing w by adding w to the codeword at the top of each 
column. 


4. Continue steps 2 and 3 until all the 2” words appear within the array. 


The completed array (see Table 2.5) has 2^ columns (one column for each codeword) 
and 2" ^^ rows, so the total number of words in the array is 2^ x 2”-* = 2" Each word 
appears once in the array. The rows of the standard array are called cosets and the 
first word in each coset is called the coset leader. For a t-error-correcting code a 
horizontal line is drawn in the array to separate rows whose coset leaders have 
weights less than or equal to ¢, from the rows whose coset leaders have weights 
greater than t. 

The standard array for the (6, 3) code, whose codewords are given in Table 2.2, is 
shown in Table 2.6. The first row contains the 8 codewords, starting with (000000) 
on the left-hand side of the row and ending with (1 1 1 000). The order in which the 
codewords appear in the first row of the array is arbitrary. The second row starts 
with (00000 1) as this is one of the words with least weight that is not in the first row. 
We could have used (00001 0), (000100), (001000), (0 1 0000), or (100000) 
as they all have the same weight as (00000 1), but it is usual to start the second row 
with the (0 0...0 1) word. The second row is completed by adding (0 0 0 0 0 1) to 
the codeword heading the column. On completing the second row, the word (0000 
| 0) has been used to start the third row and the row is completed by adding (0000 
| 0) to the codeword at the top of each column. Rows 4, 5, 6, and 7 are likewise 
completed using words of weight 1 as the coset leaders. However, row 8 requires a 
coset leader of weight 2 or more as all the words of weight | are already in the array. 
Rows | to 7 show that (001001),(010010), and (1 00100) are words of weight 
2 that are not yet in the array and therefore any of these 3 words can be used as the 
coset leader of row 8. Taking say (00 1 00 1) as the coset leader, row 8 is completed 
by adding (00100 1) to the codeword heading each column. As the code is a single- 
“tror-correcting code a horizontal line is drawn below the row containing the coset 


Table 2.5 
Standard array for an (n, k) linear code 
Co C] €? Cok .| 
W] Ci tW] €5 +W] Cox .| + wi 
Ww? Ci + w Ca + W2 Cxi H W3 
"s Cic Ww3 C2 + W3 Cx 4 + W3 
Won-k_] C| + Wn-k_| C»? + Won-k_] see Cok _ | + Won-k_] 


ih 
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Example 2.7 


Using the standard array of the (6, 3) code (Table 2.6», and assuming an i 
decoder, determine the codewords for v; — (1000 1 1), n= "1 


comp] 
(11111 D'ete 
(011100) 0), and y, < 


(a) v4 —(1 00 0 1 1) is in the first row of the standard array and i 
already a codeword. IS therefore 


(b) v>=(1 1 1 1 1 0) lies above the horizontal line and in the column headed 
(110110), so this is taken as the required codeword. The row that v» li by 


m] esi 
coset leader (0 0 1 0 0 0) and this is taken as the error pattern that (11 n r 
incurred to give v». 


(c) v3 — (01 1 1 0 0) falls in the column headed by (0 1 0 1 0 1) but lies below the 
horizontal line so giving a decoding failure. D 
The standard array provides a framework for visualizing the decoding of linear 
codes but clearly it is not practically realizable for codes with large blocklengths and 


information lengths. However, the cosets possess a structure that allows the size of 
the array to be reduced significantly (see Section 2.6). 


2.4 Parity-check matrices 


We have seen that the generator matrix ofa linear code can be expressed as G = [I,|P] 
where I, is a k by k identity matrix and the parity matrix P is a k by n — k matrix. 
From G a parity-check matrix H can be constructed as follows 


H = |P" |l.) (2.10 


where P" is the transpose of P, and is therefore an n — k by k matrix, and n- is an 
n — k by n — k identity matrix. Note that whilst Gis a k by n matrix, H is an n — k by 
n matrix. The parity-check matrix is used at the decoding stage to determine the 
error syndrome of a word. We have already defined the error syndrome of a word in 
context of the (7, 4) code and as we shall see in Section 2.5 an error syndrome can be 
defined for any linear code. Here we take a look at the relationships between 
the parity-check matrix, codewords, generator matrices, and the error-control 
properties of a code. 


Consider the parity-check matrix H of the (7, 4) code. Recall that the generator 
matrix for the (7, 4) code is 





1 00 0 1. Ged 
G= 0 1 0 0 | 1 d 
10 0 1 0 1 FT UH 
0 0 0 ! D Ll I 
and so the parity matrix is 
L 0 i 
l|. d I 
Jis 1 1 0 
0 1 1 








ut 
"d 


Parity-check matrices 
Taking the transpose (1.e. swapping the rows and columns) of P gives 
| 1 1 07 
P'=/0 1 1 ij. 
1 1 0 ] 


To complete the parity-check matrix a 3 bv 3 identity matrix 


1 0 0 
h-|01 90 
0 0 ] 


is required, and so the parity-check matrix for the (7. 4) code is 


1 J] 1 Q 1 0 0 
1 1 0 ] 0 0 ] 





Example 2.8 
Determine the parity-check matrix of the (6, 3) linear code. 


The generator matrix of the (6, 3) code is given by eqn 2.4 
1 0 0 0 ] J 
G=10 1 0 1 0 1] 
1 1 0 


0 0 ] 
which can be expressed as [/;|P] where J; is a 3 by 3 identity matrix and 


0 1 | 
P:-IlI 0 1j. 
1 1 0 


= [0 1 1 
P'-|10 1 
| 1 0 


note that here we get P! = P. From eqn 2.10 the parity-check matrix is H = [P! 4.] 
which gives 





The transpose of P is 


01 1|100 
H={1 011/01 Ol. (2.12) 
110/00 1 [1 


Consider now the product of the generator matrix G with the transpose of the 
parity-check matrix H, of an (n, k) linear code, from eqns 2.5 and 2.10 we get 


GH" = (I,|P[P" n]. 


k 
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Note that for two matrices A and B the product C= AB is defined only if 

number of columns in A equals the number of rows in B. If A isak by m matrix a 
Bis an m by n matrix then C is ak by n matrix (we can think of this as (k x ^" 
(m x n — k x n). The transpose of [P' |L, ,| is the matrix P augmented wj "t 


' ' Ww th a p, 
by n A identity matrix positioned along the last n — k rows 
i i P | 
py, {t= LP 
| | i Lh, k | 
and so 
, | P | 
GH' = |i|P|-—— 
, Ua i, 7 
P+ Phy, 
P+ P 


0. 


Note that AP =P where (k x K) x (k x (n — k)) =k x (n —k) is the order of P, 
as required, Likewise PI, =P and again with order (k x (n — k)) x ((n — k) x 
(qi Ky) ok x (nk), Furthermore because modulo-2 addition is used the result- 
inp matrix Oisak by i — k matrix whose elements are all 0. Therefore, for any linear 
code with generator matrix G and parity-check matrix H 

GH' = 0. (2.13) 


Next consider a codeword c for the information word i. From eqn 2.2. c=iG and 
multiplying this by H' gives 


'"»* 


cH' = (iG)H' = i(GH!). 
However, from eqn 2.13, GH' = 0 and so cH" = 0 where 0 is now the all-zero word 
with n — k components. Therefore, for any linear code with parity-check matrix H 
cH! =0 (2.14) 


for all codewords c belonging to the code. 


Example 2.9 


Determine the parity-check matrix H for the (5, 3) code. Show that GH' =0 and 
cH! =0 fore =(1 1010). 


The generator matrix for the (5, 3) code is 
1 0 0 | | 


G—]|0 1 0 0 | 
UN LEE 


and from G we get 





in 
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The parity-check matrix is given by [P |1], and so 
u= dul 1 -— 


Taking the product GH' gives 


GH'—|0 1 0 0 illl | 
0 


O ] ] 1] | 0 
0 | 
I+1 1-41 
= 0 I+] 
I+] 1+1 
0 0 
— [0 0 
0 0 


and therefore GH' — 0 as required. Given c — (110 1 0) then 


cH’ =(1-14+1-04+0-14+1-140-0,1-141-140-141-040°1) 
=(1+1,1+1) 
= (0,0) 


as required. LJ 


Whilst the generator matrix is responsible for constructing codewords, it is the 
parity-check matrix that determines the error-control properties of a code, It is 
useful to distinguish between the two matrices along this line, even though each 
matrix can be obtained from the other and equally represent the code. To construct a 
single-error-correcting code the columns in H have to be nonzero and unique. Each 
column in H is responsible for detecting and correcting an error in a specified 
position of the word being decoded. A zero column is unable to detect errors in the 
position that the column addresses and if two columns are the same then an error in 
either of the corresponding positions will be indistinguishable. Hence, by the col- 
umns being nonzero single errors are guaranteed to be detected and furthermore by 
being unique all single errors can be corrected. An (n, k) single-error-correcting code 
needs to correct n single-bit errors and therefore requires a parity-check matrix H 
with n columns. Each row of H generates a parity-check sum, of which n — k are 
required, and therefore H needs n — k rows. From n — k rows we can Obtain at the 
most 2"7^ — | nonzero unique columns (just as an m-bit word gives 2" — | nonzero 

different patterns) and so n < 2"^* — 1. The upper limit therefore gives 


Wr e] (2.16) 
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is the maximum number of nonzero unique columns that 


t sos. In Section Lue saw that f£ e CAN be obal 
irom y — Å rows, In Section L0 we saw that Foi AU V Integer pos 4 there Oninty le] 
single-error-correcting Hamming code with me 21 and ka M (o hy 
ee : T " 
"oc K, Hence the codes constructed here are actually the What 


Hamming co, | 
~ | -—Á— B code 
eqn 2.16 is satistied, An (qu AY Hamminy code is therefore a single Whi 


| "s ‘le M t T 7 aen So a OPSCOP fecu 
code with the largest Dlocklength that can be constructed with a A purity bi | 
Consider the partty-cheek matrix boc the (7; 4) eode (eqn 2.110). This has 7 non, : 

and unique columns and can theretore detect and correct the 7 single-bii orton hi 
bit werd. Furthermore its Ploeklength and information length NALINTY eun en: 
so the (7.4) code ts. a Hamming code (as we already know), The paritv«elie 
ot the (6, D code has 6 nonzero unique columns and can therefore detect aid corte 
single-bit errors over o-bit words, However its blocklength and information length 
do not satisfy eqn 2.16 and so the (0, 3) code is not a Hamming code, I Wewise the 
(>. 2) code with parity-cheek matrix 


à. ló aid 
ek mali 


H | 00 10 (2.17) 


ts à single-error-correcting code as it has 5 nonzero and unique columns, The (4) 
linear code with 


has only 2 rows which give a maximum of 4 columns of which J are nonzero. Hence 
there are not enough rows to give 5 unique columns, and the code is therefore 
incapable of error correction, Nevertheless its 5 columns are nonzero and so single 
bit errors can be detected. 


Example 2.10 
Construct the parity-check matrix for the (15, 11) Hamming code, 


The code has 4 parity-check bits and a blocklength of 15, so the parity-check p 
H will have 4 rows and 15 columns, The 4 rows provide 15 nonzero unique wor 
namely (0 0 0 D), (00 1 0), (00 1 1),... (LE E D, which will form the columns vie 
Although the order in which the columns appear is arbitrary, it is neverthe id 
convenient to place (0 0 0 1), (0 0 1 0), (0 1 00), and (1 00 0) on the right-hand e " 
of H as so to form an identity matrix (this will enable the generator matrix G0 
code to be easily obtained). The resulting matrix is 


L1 4d PB 186.1-1.0,80°!.1 0 0:9 
malédlod L.E6 4£ 56.1.0; Ob Oe. 28 
~ 10 0 11 1.10 10 1.1.10 0.1 90 

l1 10 1017 100 1/000 ! 


‘ ' ae 4 cun PF 
Recall that from a given generator matrix G the parity-check matrix be «o thi 
obtained using eqns 2.5 and 2.10. We can just as easily obtain G if H is gl V^ 
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here we get 


(|. 0 0 0000000 Q |I 0 € I 
oO 100000000 Q |I | o |! 
o 0 10000000 0 |I t Jol 
Qo 00 1000000 0 UL d gd» oO 
Qo 00 0 100000 0 0 | | | 
G 0 0000 | 0000 0 | Oo | Q0 


as the generator matrix of the (15, UD) Hamming code, [| 


2.5 Error syndromes 


The equation cH’ = 0 provides a way of testing whether an arbitrary ibit word v is 
a codeword, without having to refer to a table of codewords, Taking the product 
vH then 


vH' —0 if» is a codeword 
£0 if vis not a codeword. 


Assuming now that v represents a codeword e that has incurred a nonzero error 
pattern e, then the received word is » = c4: e, Taking the product of rand Af! RIVES 
vH! = (e+ eH' 
m4 dg... 
zoH teH 
r 

— eH 

because cH = 0. Therefore the resulting term depends solely on the error pattern ¢ 


and not on the original codeword c that incurs the error, The product vH" contains 
information relating to the errors incurred by a codeword and we define 


s= pH! (2.20) 


as the error syndrome of v. If » contains no errors, then e = Oand the error syndrome 
5 zero, again irrespective of the codeword c. 


Example 2.11 


rind the error syndromes ofv, =(1101 101) and», = (0100101) where v, and v; 
Present codewords of the (7, 4) code that have incurred errors. 





a 
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Using eqn 2.20 and the parity-check matrix of the (7, 


4) code, the error Syndrom, f 
0 
vy IS 


T 
Ss; = vH 


(1101101) 


= (100). 


Likewise v; — (0 1 00 1 0 1) gives s; = nH" — (0 1 0). D 


Not all error patterns give a nonzero error syndrome. If a codeword c incurs an 
error pattern e that resembles a codeword c’, then 


where c" = c +c’ is some other codeword (recall that, for a linear code, the sum of 
(wo codewords gives another codeword). The error syndrome is 


s = vH! 
= "H! 
= 0 


and therefore a zero error syndrome can occur for a nonzero error pattern and does 
so whenever the error pattern resembles a codeword. 
In Section 1.6 we defined the error syndrome, for the (7, 4) code, using the parity- 
check sums of the code (see eqns 1.19 and 1.20). The error syndrome given by 
s — vH isthesameas that given by the parity-check sums, except that we now havea 
matrix representation of the parity-check sums (i.e. the parity-check matrix H). We 
have already shown that the parity-check equations for the (7,4) code can be 
obtained from the code’s generator matrix, we can likewise show that the parity- 


check sums can be obtained from the parity-check matrix. Given v — pos o0 
its error syndrome s = (S1, 5, 53) is 


s — vH! = (vi + v2 +03 + vs, Va + v3 + v4 + ve, vi + Yo + va +v) 


and SO 5, = Vi + Y + V3 + Vs, S2 = Ya + V3 + v4 + ve and s3 = vj + v + v4 + v as given 
by the parity-check sums (eqns 1.19). 


To construct the syndrome table using the matrix representation of a linear pri 
we determine the error syndrome s — eH' for all the correctable error patterns €. 


O — uf 
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For the single-error-correcting (7, 4) code the correctable errors are the 7 single-bit- 
error patterns 


(0000001) 
(0 0 000 1 0) 
(1000000) 
and the transpose of H is 
| O0 ] 
LI 
| | 0 
H'—|0 1 1 
1 0 0 
0 1 0 
0 0 ] 


For a single-error-correcting code the error syndromes, in the syndrome table, are 
given by the rows of H'. When e = (0000001) the product eH’ gives the bottom 
row of H' , and so the required error syndrome is s = (00 1). Fore = (000001 0)the 
error syndrome is given by the second row from the bottom and so s— (0 1 0). 
Likewise we obtain (1 0 0), (0 1 1), (1 1 0), and (1 1 1) as the error syndromes 
corresponding to (0000 100),(0001000), (0010000), and (010000 0) 
respectively. The first row of H' gives (10 1) asthe error syndrome of (1 000000). 


All 7 error syndromes are in agreement with those obtained using the parity-check 
sums (see Table 1.7). 


Example 2.12 
Determine the syndrome table for the (6, 3) single-error correcting code. 


The parity-check matrix of the (6, 3) code is 


0 | 
H-—|1 0 
|. | 


The code has blocklength 6 and so we need to determine the error syndromes 


s=eH' corresponding to the 6 single-bit error patterns e=(000001), (0000 
10)...(100000). The transpose of H is 


| 0 
0 | 
0 0 





— © © 


| 
| 
0 


0 1 1 
1 01 
1 1 0 

) NN 
= 11 5 m5 
0 10 
0 0 1 


and as we have already seen the product eH" gives a single row of H when e is a 
Single-bit error pattern. The error syndrome of e = (00000 1) is given by the bottom 


CHE 
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Table 2.8 
Syndrome table for the (6, 3) 
linear code 

e S 

(000000) (0 0 0; 
(000001) (0 O 1) 
(0000 1 0) (O0 1 0) 
(0001 00) (1 0 0) 
(0 0 1 0 0 0) (1 1 0) 
(0100 0 0) (10 1) 
(100000) (0 1 1) 


row of H' and so s = (00 1). The error syndrome of (0000 1 0) is given by the second 


row from the bottom, i.e. (0 1 0); and so forth. Table 2.8 shows the resulting 
syndrome table. Li 


2.6 Error detection and correction 


At the decoding stage of a linear code the parity-check matrix H is used to calculate 
the error syndrome s of the decoder input v using s = »H'. Codewords c have the 
property that cH’ = 0 and the error syndrome of a codeword is therefore zero. In the 
event of v being error free then v — c and the error syndrome s — 0. However, a zero 
error syndrome need not necessarily imply a zero error pattern because a Zero error 
syndrome also occurs whenever an error pattern resembles a codeword. The 
probability of a codeword incurring no errors is greater than the probability of a 
codeword incurring errors that resemble a codeword, and therefore a zero error 
syndrome is more likely to be due to a zero error pattern. 

Whenever a nonzero error syndrome is obtained the decoder knows that at least 
one error has occurred. The error pattern that is most likely to be responsible for the 
error syndrome is the error pattern corresponding to the error syndrome given in the 
syndrome table. Recall that the decoder's estimate or guess of the error pattern 5 
denoted by é to distinguish it from the actual error pattern e that has occurred. The 
error pattern éis then used to correct v so giving a codeword ¢ that is the best estimate 
of the original codeword c. We can summarize decoding in the three steps: 


1. Calculate s = vH". 


2. Obtain é corresponding to s as given in the syndrome table. 
3. The decoder’s estimate of the codeword is € — v + e. 


Example 2.13 


Consider the codeword c = (1 1 0 1 1 0) belonging to the (6, 3) single-error-correctin 
code. Determine ĉ, the decoder's estimate of c, when c incurs the error patterns 
(a) e, —(0 0 1.0 0 0) 

(b)e;—(011011) 

(c) e3=(00011 1). 
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(a) The error pattern e; =(0 0 | 0 0 0) gives 


y—cd-e| 
=(110110)+(001000) 
=(1 11110). 


Using the parity-check matrix for the (6, 3) code, the error syndrome is 


D. 4] 
| 0 | 
| 1 0 
s= = (1011190) | 5 g| =a! LO 
0 1 0 
00 1 


From Table 2.8 s=(1 1 0) gives ê= (0 0 1 0 00) as the decoder's estimate of 
the error pattern (which we know is the correct error pattern), and the decoder 
estimates the codeword to be 


Capi é 


(111110)+(001000) 
=(110110) 


which is the correct codeword. 


(b) Here e,=(01101 1) and so v=(1 01 101) which gives the error syndrome 
s=vH'=(00 0). The decoder therefore can only assume that no errors have 
occurred and that é—» —(10110 1), which is incorrect. Note that the error 
pattern e2 resembles the codeword for the information word i —(0 | 1) (see 
Table 2.2) which is why the error syndrome is zero. 


(c) Fore3—(000 1 1 l) we get v=(1 1000 I) and s=(1 1 1). Referring to 


Table 2.8 we can see that s — (1 1 1) is absent and therefore a decoding failure 
occurs. a 


We have now seen two ways of decoding linear codes, one through the use of a 
syndrome table and the other using a standard array. As we saw in Section 2.3 the 
Standard array 1s useful in helping to visualize minimum-distance decoding but is 
Only practical for codes where n and k are small. Recall that in the Standard array, 
Words in the same coset consist of the same error pattern plus some codeword (where 
the codeword depends on the column that the word lies in) and therefore words in 
the same coset have the same error syndrome. Each coset could be replaced by its 
— syndrome resulting in a table of error patterns (i.e. the coset leaders) and 
'Tesponding error syndromes, which is nothing other than a syndrome table. 

re. the syndrome table gives a concise representation of the standard array. 
— l 7 we considered how the minimum distance of a code affects its error- 
control capability, we now take another look at minimum distance and the error- 
Ol Capabilities that go beyond that guaranteed by a code's minimum distance. 
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The minimum distance of an (n, k) linear block code satisfies the condit; 
on 


dmn S l--n-—k 


(2.2) 
which is known as the Singleton bound. Therefore the minimum distance c 
be greater than 1 +n — k and codes that have an Never 
dai —1-Fn—k (2.5 
bir. 
are known as maximum-distance codes. Rearranging eqn 2.22 to (d, — 1)/2 
(n — k)/2, and recalling that a code with minimum distance : " 


Amin CAN correct up to 
t = (di, — 1)/2 errors, we see therefore that 


A= k = 24. (2.23) 
Now (n — k) is the number of parity bits and therefore eqn 2.23 tells us that 4 
maximum:-distance code capable of correcting ! errors requires 2/ parity bits, i.e. ? 
parity bits are required to correct each error. Few codes achieve the Singleton 
Bound, and for such codes more than 2 parity bits are required for each correctable 
error. We might expect maximum-distance codes to always have good error-control 
capabilities, but this is not necessarily the case. The (3, 1) repetition code has 
dmin = 3. 1t therefore achieves the upper limit of the Singleton Bound and is a 
maximum-distance code, as are all the (n, 1) repetition codes, yet the code is by no 
means a good code. One of the most important class of maximum-distance codes are 
the Reed Solomon codes, these are considered in Chapter 7. 

Whilst the error detection limit 7 of a linear code gives the maximum number of 
errors that the code is guaranteed to detect, there are however many more error 
patterns with more than / errors that are also detectable. For example the single- 
parity-check codes have dmin = 2 which guarantees single-error detection, but the 
codes can detect all error patterns with an odd number of errors. The (7, 4) code has 
dain = 3 and yet we have already seen that the code can detect some 3-bit and 4-bit 
errors. In a linear code, error patterns that resemble a redundant word are detectable 
because they give a nonzero error syndrome (only codewords and error patterns that 
resemble codewords give a zero error syndrome). There are 2* codewords and 
2" — 2* redundant words in an (n,k) code, and therefore an (n, k) linear code - 
capable of detecting 2" — 2* error patterns. The (7, 4) code has 16 codewords and 112 
words that are redundant to the code. Error patterns that resemble any one of the 

112 redundant words are detectable and therefore the (7, 4) code can detect ] 12 error 
patterns and not just the 7 single-bit errors and 21 double-bit errors guaranteed = 
the code's minimum distance of 3. Likewise, the (8, 7) even parity code has 12 
codewords and 128 redundant words, it can therefore detect 128 error patterns and 
not just the 8 single-bit errors guaranteed by the code’s minimum distance of 2. 
The number of correctable error patterns for a linear code is likewise grester im 
that determined by the code's error-correction limit. Let's reconsider the à e 
array for a t-error-correcting code. As we have already seen, in Section 2.3, tne at 
leaders below the horizontal line in an array represent error patterns with more t 3 i 
terrors. Nevertheless a word v will be correctly decoded if the error pattern that Y s 
incurred is the coset leader of the coset that v lies in (irrespective of whether y a! 
above or below the horizontal line). The coset leaders, of which there are 2Z a pt 
correctable error patterns and therefore an (n, k) linear code is capable of correc 
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n-k error patterns. When constructing a standard array, error patterns with / or less 
ways end up as coset leaders, whereas error patterns with more than ¢ errors 
as coset leaders (recall that the construction of cosets below 


2 
errors à | f 
may OT may not end up | | 
he horizontal line is arbitrary). Therefore the correctable error patterns below the 
the f 


al line vary according to how the array is constructed. 


horizont 


2.7 Shortened and extended linear codes 





One problem encountered in the application of error-control codes is thatit may not 
be possible to find a code with suitable blocklength, information length and mini- 
mum distance. In which case, it may be necessary to select a code that is closest to 
that required and modify it to meet the requirements. Various modifications can be 
made to a linear code, here we consider modifications based on shortening or 
extending codes. 

An (n, k) linear code can be shortened to an (n — i, k — i) shortened linear code by 
setting the first (left-hand side) / information bits to zero. Encoding and decoding 
can then be carried out in the same way as for the (n,k) code, that is using the 
generator and parity-check matrices of the (n,k) code G and H respectively. An 
alternative is to construct a generator matrix and parity-check matrix, for the 
shortened code, from G and H. The generator matrix of the shortened code is 
obtained by omitting the first / rows and columns of G, and the parity-check matrix 
Is obtained by omitting the first / columns of H. Codewords then have n — i bits but 
note that the number of parity bits remains the same beause (n — i) — (k — i) =n — k. 
Consider the (15, 11) Hamming code with generator matrix 


I0 0505000 0 0 0 O0 0 1 0- 0 |] 
0.10 060 0 0 0 0 0 DR RJ 
06 01 000 00 0 0 D E Lol 
0001209000 00 0 U i d Il Ọ 
00001000000 0 ] 1 | 
6G—-|0000017 0000 0 1 0 1] O0 
Ü 0 0 0 0 0 1 O0 O0 0 O0 0 1 0 1 
oe 0 0 0 0 0 O 1.0 0 9 Dod po 
0000000010 0 1 1 0 0 
0000000001 0 0 1] 1 O0 
0000000000 1 0 0 1 1 
Removing the first 3 rows and columns gives 
10000000 1 ] 1] 0 
01 000000 0 1 1]. 1] 
001 00000 1 0 1 0 
00010000 0 1 0 1 
aie 00001000 | O L I V2) 
00000100 ] I 0.0 
0000001 0 0 ] | O0 
0000000 1 0 0 1 1] 








IT 
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as the generator matrix of the resulting (12. 8) shortened code. The —— 
matrix of the (15. 11) code is Y«he 


'111101011001|10090 
‘ort LT tLorots1o0} 01049 
H-|90111101011/|00190 
1121101017 1001/0001 


ri O101100/1000 
1101011 0/01 0 0 | 
hel P 11/0010 328 
, 


i 1010 | 
ir otioortsooods 


as the parity-check matrix of the (12,8) code. Note that we could have used 
H — (P! I] to determine the parity-check matrix of the shortened code. The mini- 
mum distance of a shortened (n — i.k — i) code is greater than or equal to the 
minimum distance of the (7. &) code from which it is derived. Hence by shorteninga 
code we know that we are not reducing its error control capability. Here the panty- 
check matrix H of the shortened code has 12 nonzero unique columns and so the 
code is capable of correcting single-bit errors in 12-bit words. Therefore the (12.3) 
code constructed here is single-error correcting, just like the (15. 11) code from 
which it was constructed. 

A common way of modifying an (7n. k) linear code is by adding an overall panty- 
check bit to produce an extended (n + 1, k) code. The parity-check bit is added as so 
to give even parity codewords. as this will preserve the linearity of the code. The 
Hamming codes are often extended in this way, recall that for all integers r > 3 there 
exists a (2^ — 1. 2 — 1 — r) single-error-correcting Hamming code with minimum 
distance 3. The inclusion of an overall parity-check bit gives the (2". 2— 1-7 
extended Hamming codes with minimum distance 4. which are single-errec 
correcting and double-error-detecting codes. Consider the (8. 4) extended Hamming 
code, to construct the codewords we take the codewords of the (7, 4) code and add an 
overall parity-check bit. If (ii, i». iz, is, P1. P». Ps) is a codeword of the (7, 4) code then 

€ = (ò, iz, iz, is, Pi, P2- P3.) 2.26) 
is a codeword of the (8.4) code, where p, =i +i +i piii znd 
pi—ij—i;—is,are the parity bits given by the (7, 4) code and 


p=i +i +i +i +p +p+p (2.27) 
is the overall parity-check bit. Substituting pı, p», and p; into p gives 
pHi thsi +is+(ùi th +h) + (i +i + i)+ (i $244) 
which reduces to 
p= iy + is + is. (2.28) 


oles 











Shortened and extended linear codes | 69 


Recall that the generator matrix G of the (7, 4) code in its systematic form is 
ec 
1 0 0 0 1 0 1] 
0 1 0 0 l 1 1 
06-lo010/|110 
D g. 9 ] 0 1 1] 


nd that every column in the parity matrix P produces a parity-check bit. To gen- 
mie an overall parity-check bit, in accordance with eqn 2.28, we add a fourth 
column to P to give 


o-oo o 
=o oa © 
p p pee 


0 1 1 
lr a 
Lic (2.29) 
Pr j 


>O O — o 


0 


as the generator matrix of the (8, 4) extended Hamming code. Note that the column 
that we have added to G is simply the sum of the other 7 columns (taken a row at a 
time). If we let i= (i4, i2, i3, i4) then the codewords of the (8, 4) code are given by 


c — iG 
l 
0 
] 


= (7). Prdy, $3) 


= C CS 
= 2 Oo (A 


| O I 
i l ] 
1 1 0 
0 1 ] 


ooo — 
>O O — oS 


] 
= (i1, i2, i3, Ia, i + do + i3}, ibh +i} + i4, ii +i + i4, ii +i + da) 
= (1), 12,13, 14, pi. pz. pa. P) 


as required. 
The parity-check matrix H of an extended (n + 1. k) linear code is given by 


(2.30) 


where H' is the parity-check matrix of the (n, k) code. This assumes that the overall 
parity-check bit is on the right-hand side of codewords. as given in eqn 2.26. The 
resulting error syndrome is 


S = (51.845,53... M b) (2.31) 


Wheres, s... Sy— are the parity-check sums given by H and sis the overall parity- 
m. sum. Using eqn. 2.30 and the parity-check matrix for the (7. 4) code we find 
at the parity-check matrix for the extended (8. 4) code is 


|I 13d 0-1 6 0 6 
| [0 1 1 10100 : 
A=) 101001 0 30 

|! 1 L 11 i Y 2 
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If needed, we can use elementary row operations to reduce H toa 
Given y = (vi v3, V4, Va Vs, v 


lS 5 = (51, 5, 


vx VI -p V9 4 V1 }. V4 | V5 |. V6 IE V? 4 Vg 


SYStemati 
‘4, y) Where 


6: V7,Vg) Its error syndrome C form, 


is the overall parity-check sum and s4, 55, 3 are the same as the 
given by the (7,4) code. Recall that the rows of the 
syndromes in the syndrome table. The (8, 4) code h 
(000...00),(000...10),..., (100. 
syndrome table (see Table 2.9). Note 
s is always | because the occurrence of a single error gives incorre 

Decoding a word v is achieved by determining the e 
If the parity of v is correct then s = 0, otherwise s = 
gives s = l, and the syndrome table can be use 
but $1, 62, Or sy are nonzero then more than l e 
v contains an uncorrectable error pattern. 


Parity-che 
transpose of H pive 
as 8 correctable 
.. 0) and corresponding error syndrome 
thatin the syndrome table the ove 


Ck Sumy 
| the erro, 
single-bit Crrors 
Sin its 
rall parity pj 
ct parity, 

rror syndrome using s = TIL 

|. The occurrence of à single error 
d for single-error correction. If 5 =9 
rror has occurred, and we assume that 


Example 2.14 


Consider the (8, 4) extended Hamming code. Determine the 
when the codeword c = (00101101) incurs the errors 

(a) e, =(00100000) 

(b) e—(100001 0 0) 

(c) e,=(0000011 1), 


outcome of a decoder 


(a) The received word is v2 ¢ + ej — (0000 I 10 1) and using s — »H' (with H 
given by eqn (2.32) gives s— (110 1). Hence s= 1 and so we assume that a 
single error has occurred. From Table 2.9, s— (1 10 1) gives é - (0 0 I 000 
0 0), and carrying out error correction gives =v J- 6 (00 101.101), which 
Is the correct codeword. 


(b) Herer-c--e3 —2(1010100 |) which gives the error syndrome s = (1 1 | 0). 


The parity-check sum s — 0 is correct, however the other 3 check -— 
Therefore the decoder knows that more than 1 error has occurred and so this 
gives a decoding failure. 


(c) Here » 2(00 1 0 10 1 0) gives s—(0 1 1 1) and the decoder incorrectly 


" | 
assumes that a single error has occurred. From the syndrome table s = (0 1 1 1) 


Table 2.9 

Syndrome table for the (8, 4) extended code 
e s 

(00000001) (000 1) 
(000000190) (001 1) 
(00000100) (0 10 1) 
(00001000) (1 0 0 1) 
(000100090) (011 1) 
(00100000) (1101) 
(01000000) (T 1f 1) 
(100000090) (10 1 1) 


u———— CGU 
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‘ves é — (0 0 0 10 0 0 0) and the decoder concludes that 6 = v -- e -(0011 


0 1 0) is the required codeword, which is incorrect. ry 


problems 
> | Show that the sum of any two codewords belonging to the (6, 3) linear code 
g (see Table 2.2) is also a codeword. Construct a table showing addition of 


codewords belonging to the (6, 3) code. 


?2 Let c; and c; respectively be the systematic and nonsystematic codewords of 
the (5,3) code given in Table 2.3. Determine the correspondence between.c; 


and c;. 
23 Show that the (7,4) linear codes generated by 
L 0 0 0 1 Q0 I 
0 1 0.0 1] ] 1] 
“=!o 0101 1.0 
0 0 0 1 0 1] I 
and 
ied ft I, E I ] 
0 1 1] 1 0 1 O0 
log t 110) 
09 0 0 IO l I 


are equivalent. 
2.4 Given the (7,3) linear code with generator matrix 


i | PU IO S 
G—|0 ] 1 10 1 0 
1 10 1 00 I 


determine a systematic form of G. Hence find a parity-check matrix for the 
code. 

2.5 Given that c= (hl, i3, pi, P2,p3) is a codeword of the (6,3) linear code 
determine the parity-check equations for pı, p», and p; in terms of ij, i», and às. 
Hence show that | 


piı= ù +p 
P =h +p 


Pp =h+p | 


- j Is the Par ity of i= ( 1, 42, 73) and therefore codewords can be expressed 
far he : » 13,1) +p, 12 + p, i3 + p). Note that this gives a simple encoding rule 
— J ) code. If i has even parity (p — 0) then Pı =i, pi—is pii and SO 
inverse pa as 13). Otherwise for odd parity (p= 1) each parity bit is the 
- l.i 4 D © corresponding information bit, so giving c= (ij, tz, i£, i+ 1, 





EE 
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2.6 Determine the minimum distance and error-control limits of the (5, 3 
given in Table 2.3. >) Code 


2.7 Show that the generator matrix G (eqn 2.4) and p 
(eqn 2.12) of the (6,3) code satisfy GH' 
(Table 2.2) satisfy cH' =0. 


arity-check m 


atri 
— 0 and that all the code wi. 


Words C 
2.8 Construct the syndrome table for the (7, 3) linear code given in Problem 24 
Given that c — (101001 1) is a codeword determine the decoding decisions 
when ¢ incurs the errors 
(a) ei =(00 10000) 
(b) es =(1001000) 
(c) e,=(0011101). 


2.9 Show that the (n, 1) repetition codes are maximum-distance codes. Write 
down generator and parity-check matrices for the (7, 1) repetition code. 
2.10 Given the parity-check matrix 


l1 1 1010 0 
H—|0 1 1 10 1 0 
1 10 1252 9 i 


of the (7, 4) Hamming code, determine systematic forms for the parity-check 
and generator matrices of the (8,4) extended Hamming code. 


Given that c 2 (0110001 1) isa codeword of the (8, 4) extended Hamming 


code with even parity, determine the decoding decisions when c incurs the 
errors 


(a)e1—(00000100) 
(b) e3—(01010000) 
(c) e3—2(00011010) 








iC codes 





In going from arbitrary block codes to linear codes the characteristic of linearity 
ables the minimum distance and therel ore error«contro] ci pabilities of codes to be 
easily determined, and encoding and decodin gcun be concisely described in terms of 
matrix algebra. A second characteristic is now considered, namely that codewords 

and in doing so further gains are made, in particular with regard to the 


are Cyclic, | | | 
implementation ol encoding and decoding. 


en 


31 Definition of cyclic codes 


With cyclic codes it is conventional to think of codewords as starting with the 
component c,. , and ending with co, and as such codewords are represented as 


em (Cy. TLOS ITE Cfo. A 


This representation proves more convenient than that previously used, namely 
€— (Cp Cn.. Chl Cn), and should not cause confusion, The coefficients cg and c,- | 
are now referred to as the least-order and highest-order coefficients respectively, and 
define the low-order and high-order sides of c. A cyclic shift leftwards on a codeword 
cis one in which each bit is shifted one place towards the left with the bit ¢, 
occupying the position vacated by co. The resulting word is 


,l — LI ' , , 
Ü sm Lace, rb]. 


Bits can be shifted towards the right in a similar manner, and shifts may be by more 
than one bit. So, for example, a cyclic shift on e' of 4 bits towards the right gives 


H 
C = (c2, C], COs Cn—-15 «5 C4, c3). 


A cyclic code is a linear code that has the property that a cyclic shift on any of its 
codewords produces another codeword. The cyclic shift may be leftwards or 
rightwards by any number of places. Hence if c given above is a codeword of an (n, k) 
cyclic code then c' and c" are also codewords. 


Example 3.1 

Returning to the (7, 4) Hamming code we find that all the codewords satisfy the 
cyclic requirement. For example, let's consider the codeword c3 (0011101) 
Im In Table 1.6. A shift of 2 places to the left produces (1110100), which is 
c codeword C14. A further shift of 3 places to the left gives (0 1 001 1 1), which is 
4 and a shift of | place to the right gives cio — (101001 1). Mi 


T . ‘ * ' 
nhs z UN example does not prove that the (7, 4) Hamming code is cyclic, it only 
that some of its codewords have the required cyclic property. However, the 





-J 
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code is indeed cyclic, the reader may wish to consider cyclic shifts 0 
words. Not all linear codes are cyclic. A linear code may have some c 
satisfy the cyclic requirement, but other codewords that fail to do S0, 
therefore not cyclic. 


Odewords that 
SUCH. codes ate 


Example 3.2 | 
Consider the (5,2) linear code with nonzero codewords 


c= (01101) 
c; = (10111) 
cy - (11010). 


A leftwards shift of 1 bit on e; produces c;, but a further shift of 1 bit leftwards gives 
(10101) which is not a codeword. The (5, 2) linear code is therefore not cyclic, 


D 
3.2 Polynomials 


As cyclic codes are linear, encoding and decoding can be achieved in the same way as 
for linear codes, namely using matrices. However, with cyclic codes, a polynomial 
representation of codewords is often more suitable and encoding and decoding rules 
can be formulated in terms of polynomial algebra. Before proceeding to consider 
cyclic codes in terms of polynomials, it is useful to look at polynomial addition, 
subtraction, multiplication, and division, for these are required for encoding and 
decoding cyclic codes. 


An n-bit word (a,. 1,0, .5,..., A2, A1, ao) can be represented by the polynomial 
p(x) T dp" T "MET a qo 4 x ax? + aix + a (3.1) 


where the n components of the word a, 1, à, »,..., 45, dj, ag form the polynomial 
coefficients. Note that the highest possible power of x in the polynomial repre 
sentation of an n-bit word is n — 1. For a binary word, the components a; are binary 
and hence the polynomial coefficients are 0 or 1. For example, the words (01 10 
010) and (00101 1) give the polynomials 


pix) 2 x «x - x 
and 
pix) mx 4x1 


respectively. The degree of a polynomial is the largest power of x that has a nonzer? 
coefficient. The above polynomials p;(x) and p2(x) have degrees 5 and 3 respectively. 


Two polynomials can be added together by adding the polynomial coefficients 
pairwise, so the sum of the two polynomials 


Pa(X) = an-1X"^! an 2X"? ...-E ayx? + aix + do 
and 


Py(x) = by-ix" + bx? + ++ + bax? + bix + bo 


—~— 
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pa( X) + py x) E (an-ı 7 by-,)x" a (d, + Dy2)x”" : 
toc (az + b2)x* + (ay + by) x + (ao + bo). 
if the coefficients are binary then polynomial addition is simplified because 
modulo-2 arithmetic is used (see Table 1.4). Hence if a, = b; then a; + b; = 0 modulo-2 
and the resulting polynomial does not contain an x' term. Consider again the 
polynomials pí(x) =x +x +x and p(x) — x^ + x + 1, their sum is 
pi(x) + pi(x) = Q8 +x x) 4+ G8 4x41) 

- (X x! xà x(1 + p+! 

=x xt xta | 
as | + | = 0 modulo-2. Polynomial subtraction is the same as polynomial addition 
because —1 = + | modulo-2. Note that polynomial coefficients are assumed to be 
binary, and subject to modulo-2 addition, unless stated otherwise. 

The product of two arbitrary polynomials is achieved by determining the products 
of all the terms taken pairwise and then cancelling like terms. The product of pi(x) 
and p;(x) is 

in hal ae all 3 
py(x)p2(x) = Ge + x" 4+ x)(x +x 41) 
(X9 4 3P 4-37) 4 x Bar d + Oe eX) 


= x* 4y + x? 4 x^ +x. 


| 


The degree of the resulting polynomial is clearly the sum of the degrees of p(x) and 
p(x). 

Polynomial division can be carried out using the long-division method that is well 
known in ordinary arithmetic. If pi(x) is divided by p2(x) then p,(x) is referred to as 
the dividend and p(x) as the divisor. As with ordinary division, polynomial division 
yields a quotient and remainder denoted by the polynomials g(x) and r(x) respec- 
tively. Polynomial division is achieved by successively removing factors of the 
divisor from the dividend until the resulting remainder has a degree less than that of 
the divisor. Note that in the ordinary long-division method, factors of the divisor are 
removed by subtracting them from the dividend, but as we are using modulo-2 
arithmetic we add the factors to the dividend. Consider again p,(x)=x° + x* x 
and p(x) — x^ + x + ] then p,(x) divided by p(x) gives 


xX +x+l 
X x+l)x x +x 


PE EY 
Lak s a eee [step 1 
— XŻÁ+P++X+HX 


4 2 
ae mn Fx TA |step 2 
"MC 


3 
X 4+x-+ | [step 3 
— x-l. 








à i 
1 
- 
i 


[n Step | the divisor is multiplied by x^ and then added tot 
the square root sign) so removing the term with the hig 
dividend. This leaves a remainder with x* as the highest t 
above the dividend. In Step 2, a factor of x times the diviso 
of Step 1, so removing the x^ term. The factor x is adde 
dividend. Finally, Step 3 is required to remove the x? t 
Step 2, this is achieved by adding | times the divisor 
Again the factor | is added to the x^ + x term above th 
remainder has a degree less than that of the divisor, divis 
the remainder at the end of Step 3 is the required remain 
is given by the sum of the terms noted above the divid 
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he divideng 

hest Power, nta 
erm. A note of x " the 
rls added to the re "ins 
d to the x? term a a 
erm from the rem 
to the remainder 
e dividend, After 
ion is therefore CO 
der r(x) = x 4 LT 
end, and so q(x) = 


ainder o 
Of Step 2 
Step 3, the 
Mplete ang 
he quotient 
FXI 
Example 3.3 
Divide x^ 4- x? 4+ x* 4 x24] by x^ 4 x^4- f: 


x? 4 x8 4 y? Toe8 e. ax*-. x3 
x2 4. xll 4 y9 
xll.p y10 4 X8 
xlü 4. x9 Lg? 
— 4744334] 
x* 4 x! + 
ae ra 
x! + x8 4 x^ 
x8 a. sS a 
—- 1 
The quotient is therefore q(x) 2 x? + x8 E x74 x54 x443 and the remainder 


r(x) — 1. [] 


Polynomial division is quite similar to ordinary division in many aspects. If we 


take an integer /, and divide it by another integer J to give a quotient 4 and 
remainder r, then 


Il —qLb-cr 


where 0 <r < |D] and where the quotient q and remainder r are unique for every pair 
of integers J; and J. This is known as the Euclidean division algorithm. A simple 
example of this is 17 divided by 5, which gives the quotient 3 and remainder 2, and 50 
according to the Euclidean division algorithm we can express 17 as 17 23x 5 * 2. 
The Euclidean division algorithm applies to any pair of integers, and whilst possibly 
appearing to be rather trivial and obvious, it is an important property of integers 
that carries over into polynomials. For polynomials, the Euclidean division algo- - 
rithm tells us that given a polynomial p,(x) divided by some other polynomial p(x}; 


NNNM 
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then 
pi(x) = 9(x)p2(x) + r(x) (3.2) 


(x) and r(x) are the quotient and remainder respectively. We have already 
= Ax) xx side | According to the Euclidean division algorithm pj(x) — 
5 " (x) + r(x), constructing the right-hand side of this expression gives 

q N)P2“ | 

x) + r(x) = (x? 4- x 4- 1)G8 E x 1) t+ (x *- 1) 


g(x)PX 
(x5 x3 x) +(x" xi x) d (X86 x M) (x 4 1) 


| 


=y + x^ 4 x? 


= pix) 
as required. 


Example 3.4 
In Example 3.3 we saw that x 


quotient and remainder 
q(x) =x’ + 4x x p x* xr 
Hx) md 


24 x? 4 x* +x + l divided by x - x^ - 1 give the 


respectively. Using the Euclidean division algorithm gives 
(GO a x o6 e x* 9 eP)( x^ 1) 
= (x2 4 xl! a xl9 4 x 4 x7 4 x5) 4- (x! 4 x9 Hx 4 x7 + x6 4 x5) 
+ (9 4+ x8 x! Ex! 42°) + | 
=x x! xt. x 1 


which is the required dividend. | a 


| Later we shall see that encoding and decoding cyclic codes requires polynomial 
division, and in particular we will be interested in the remainder after division. The 
remainder can be expressed as 


r(x) = Raw [p x) (3.3) 


Em the right-hand side is taken to mean the remainder of p(x) divided p(x). 

c we can use the modulo notation pi(x) 2 r(x) modulo-p(x). If the 

i$ mial p(x) is a factor of p,(x), so that p(x) =f(x)p(x), then dividing p\(x) by 
*) gives the quotient g(x) = f(x) and remainder r(x) = 0. Hence 


Ry) Uf (x)p(x)] = 0 (3.4) 


for 
any polynomial p(x), we can also express this as 


f(x)p(x) = 0 modulo-p(x). (3.5) 








- 
A 
V 
x] 
i 
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Consider, for example, pi(x) 9 x* + and p» 


(Amys here : 
p(x) because x“ +x = x(x? 4 I), and so p(x) = X^pa(x). Dividing s 4 factor of 
gives q(x) = x^ and r(x) = 0, as can be easily verified by long division and ih Y py) 
: CTefore 


Ryo [x T x zx p 


It is not always obvious that one 


whether p(x) is a factor of p I(x) 
remainder is zero. 


polynomial is a factor of a 


nother, T | 
we need to divide p,(x) by p © establish 


2(x) and check if the 


Example 3.5 
Determine whether P(x)=x° +1 is a factor of pix) Sx! 4x34 524 | and of 
p(x) = x! + x° + x! T x? +1. 


Dividing pi(x) by P(X) gives 


yF] 

x? 4 x 
x54] 
— 0. 





Hence the remainder is 0 and 
q(x)= x?+1 we therefore see 

Dividing p(x) by p(x) gives 
Kx) ex a- ar l, and so p(x) is 


SO p(x) is a factor of pi(x). Furthermore because 
that p(x) =(x* + I )p(x). 

the quotient g(x) = xt + x? +x and the remainder 
not a factor of p(x). [] 


A cyclic shift on an n-bit word can be expressed in terms of polynomials. Con- 
sider (a 


n-bn-2....,05,d,,09) shifted by | place to the left, to give (a, 
n—3,...,01,009, Q4. 1) and let 


p(x) - ds iX" ^* T ds 5x" * Teu ajx? + ajx+ ao 
and 


P(X) = a, ax"^! a, 3x72 4... aix? + aox + an1. 
Itcan beshown that p'(x)is given by the remainder of xp(x) divided by x" + 1, so that 
p'(x) = Rei[xp(x)]. (3.6) 


Assuming that 45—| — then xp(x) will contain an x"-term, and taking xp) 
modulo-(x" + 1) has the effect of replacing the x" term by 1, so that overall the x 
term has 'cycled' around from the high-order side of the polynomial to the low-order 
side. For example consider a cyclic shift on (101100) of 1 place to the left. Here 
P(x) 7 x? +x? + x? and xp(x) = x$ + x* 4. 3, The remainder of x$ + x^ + x? divided 
by x° + lis x* + x? + 1, which gives the word (0 1 100 1) as required. If a,.., — 0 then 
eqn 3.6 gives p'(x) — xp(x). 
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(X6 | 
TOY NU yry v EL amd po(vy= v. dv represent two 7-bit words w, and 
\ nt f 


-— ay eqn 46 find the resulting words when wy and wy are shifted leftwards by 
baa ET A it 
| pt V ; i 

e xS 4 x* 4 1, the woduet vpiv) gives v 4 xv 4 v Dividing x^ + x! + x by 
|a 2H 


pam 


paves the remainder A x4. | which corresponds to the 7-bit word (00010 1 
n - y check, note that pix) = ve 3 | gives the 7-bit word (1000 10 D), which 
hen shifted 1 place towards the lett gives (000 LOT I) as already obtained. 

Gaver OY VEX. then ape) o d NO and dividing by x’ +1 gives the 
somaimnder v! (ov Hence the required word is (00 10 100). We can again easily 
check ihat IS IN correct, Note that here the degree of Np(X) is less than 7 and so 
Anus voco by vd E gives pov) as the remainder (with a zero quotient). g 


We now reconsider polynomial multiplication, We have already considered the 
product of iwo arbitrary polynomials pi(x) and pa(x), and we have seen that the 
ganw et oS aaa is the sum of the degrees of p(y) and p(x). If p(x) and 
c represent abit words then the degree of p(y) = papax) could be greater than 

tanach case piov could not represent an bit word, To address this, we define 
à sevetsd Kind of multiplication that ensures that the degree of the product of two 
pelyaenmials does not exceed à — 1. Given the polynomials pi(x) and p(x) then 


PUD) = Reif apal) (3.7) 


has degree less than or equal to à — | and can therefore represent an n-bit word. 
Consider, lor evample, pi = NI o wand py <= x! dex + E representing two 5-bit words 
QUO LO and (OUO E D respectively, The product papala) = x! ey? + x? + x has 
dege ^ and therefore cannot represent words with less than 8 bits. However the 


ander et Pops) divided by X? + 1 gives x+ 1 which can be expressed as the 
A UT word (0 Qu | ch 


43 Gene i 
3 Generator polynomials 


E Virgi Ay y 1 4 M 
onsider an (1, &) evelic code with codeword 
e =a (Cy. ls Cp. 2^ see C^, C) t co) 
Uhe CO 


į « la " x ` 
tictents of the codeword can be used to construct a codeword polynomial 


| e 
elx) = Cp VÀ. + Cy X" sb. mi + er +:C1X + CO 


NO gms 


M YO bs — ` ^ 1 . 
de w hich oly n representation of c, We now return to the (7, 4) Hamming 
Sas weh 


Code 


ave already seen, is a cyclic code, The first nonzero codeword, in 


Re list ap 
` U s » ^ 
Words given in Table 1.6, is 


ey (000 L0 I 1) 
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which can be expressed as 


x) = Ox? + Ox? + 0x + Lx? + Ox? + 1x +] 


that rs 
^S f -\ aia 3 - | 
i ! S X ; — X -+ X +- * 


Table 2.1 shows the codeword polynomials, and corresponding codewords, for al 
“he codewords belonging to the (7. 4) Hamming code. 

Consider now the codew ords C; = zs F0 001011) and C» = {00 1011 0) with code- 
won aram mials c(x mx o txt and e(x)-x txt x respectively, The 
-odeword e- can be obtained from a single leftwards cyclic shift of ¢,, and the cyclic 
hip sna ween the 2 codewords can be represented as 


ex) = xt + x^ 4x 


x(x t x 1) 
= xcix). 
Further cyclic shifts of e; produce the codeword polynomials 


Cs(X) = xc (x) 


fo 
=) 
Ca 


cu (x) = x'a(x). 


Table 3.1 

The (7, 4) codewords and codeword polynomials 
Codewords c Codeword polynomials c(x) 
e=(0000000) ép) 
e,=(000T OT 1) TOD +x+l 
e-=(0010110) e(x) =x" ex ida 
e;=(0011107) esx) =X" +x" pax d 
e;—(010011 1) cx) =X? +x xttl 
cs=0101100 ex) =X" Tut EFi 
e,=(0110001) cx) = x +x" +1 
e:—-i011101 0) ex) =X" dat LXX 
¢,=(1000101) cg(x) = x8 x7 24: 1 
cs —(100 1 1 1 0) co(x) 2 x8 - x3 xx 
€97(101001 1) Cio(x) 2 xS - x* - x 41 
e;—-(1011000) eusa EX EX 
€:2;—(1100010) eu) =x" +x° T 
€j:3—(1 101001) cu) = x tx +x" ^ 
€i4—(1 110100) Cu) =x" +x° +x +N 
€i$—(1 11111 1) cis(x) 2 x8 x5 x4 px RORXEÍ 


ENDE 
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odeword polynomials can be generated from c;(x) by multiplying c;(x) with 
guer of degree less than or equal to 3. For example 


polynomials 
(x + 1)c\(x) = x*4- x^ 4x oe c3(x) 


and 
(x? + x^)ei (X) = x? 4-37 4- x* 4- x^ e €14(X). 


the product of c;(x) = x^ + x 4-1 with every polynomial of degree less 
than or equal to 3 produces the complete set of codeword polynomials of the (7, 4) 
code. The polynomial x?+x+1 is therefore able to generate all the codeword 
polynomials of the (7, 4) code, it is called a generator polynomial and is denoted by 
g(x). The existence of a generator polynomial is not restricted to the (7,4) cyclic 
code, but is an important property of all cyclic codes. In an (n, k) cyclic code there 
exists a unique generator polynomial from which all the codeword polynomials can 
be generated. The generator polynomial is unique within the code and so none of the 
other codeword polynomials are able to generate the complete set of codeword 
polynomials. The generator polynomial can be likened to the generator matrix of a 
linear code, in that they are capable of generating all the codewords of a code, and in 
Section 3.9 the relationship between generator polynomials and matrices will be 
considered. For an (n, k) binary cyclic code the generator polynomial has the form 


(3.8) 


Furthermore, 


g(x) T gy il Heuk- 2 aiid + gx? + giX + £o 
where the coefficients g,. 4.1, 2n—k—2s «+ -, 225, gi are Qor 1. The coefficients of the first 
and last terms are always equal to 1, and so 


2n-k = 1 
go = I. 


ta " term 1s always present in the generator polynomial and there are no higher 
Didi te "pi gei the degree of the generator polynomial g(x) of an (n, k) cyclic 
k~ an ke, urthermore, the product of g(x) with every polynomial of degree 
ito, S — all the codeword polynomials of an (7, k) cyclic code. The 
code and La g(x) is the smallest degree codeword polynomial of a cyclic 
that the d er codeword polynomial has degree less than or equal ton — k. Note 
egree of g(x) is equal to the number of parity-check bits of the code. 


3.4 
Encoding cyclic codes 


We ha 

generate, mb - rr codeword polynomials of a cyclic code have the code’s 

Must first "ices ie g(x) as a factor. Hence to encode an information word we 

Suitable Polynomial € information word as a polynomial and then construct some 

In Which Spem lal that has g(x) asa factor. As with linear codes, there are two ways 
ing can be achieved, namely nonsystematic and systematic encoding, 


er 4 
nonsystemaiic encoding first. 


we consid 
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Nonsystematic encoding is the easiest way of encoding, but not necessarily th 
preferred method because the resulting codeword polynomials represent ng ° 
systematic codewords. We have seen that the product of a generator polynomia] 2 
with any polynomial of degree k — | or less produces a codeword Polynomial for an 
(n. k) cyclic code and it is this that forms the basis for nonsystema 


(n. | ! tic encoding. The 
information word i to be encoded is first expressed as an informati 


ai on polynomial i(x), 
sou l 


i -— UN le), ae Ir, ly, ig) 


i 


tx) = ip ax + ix qm ix? + ix + ig. 
We then simply take the product of i(x) and g(x) to give the codeword polynomial 
c(x) = i(x)g(x). (3.9) 


Taking the product of g(x) with all the information polynomials i( x) generates the 
complete set of codewords. Note that there are 2^ polynomials of degree k — | orless 
(1e. the same number as different patterns in a k-bit word). To illustrate why 
encoding using eqn 3.9 is nonsystematic we reconsider the (7, 4) code. The generator 


polynomial of the (7. 4) code is 
s) — x x1 (3.10) 
as already seen in Section 3.3 and taking say i — (0 1 0 1) gives i(x) = x? + 1. Fromeqn 
3.9 the corresponding codeword polynomial is 
c(x) — i(x)g(x) 

= (x* +: De +x +1) 

e+e 42427 45041 

-—3x3x exh 


giving the codeword e — (0 1 00 1 1 1), which is not the codeword for (0 1 0 1) but 


rather for (0 1 0 0) (see Table 1.6). The encoding rule c(x) = i(x)g(x) therefore pro- 
duces nonsystematic codewords. 


Example 3.7 


Determine nonsystematic codeword polynomials, for the (7,4) code, given i= 
(1 100) and i;—(10 0 1). 


The information polynomial corresponding to i, is i(x) — x? 4- x2, and taking 
gíx) — X! x41 gives 


c(x) — i(x)g(x) 
= (x +PP - x 1) 
— x5 x*« Xx tót 
—3X xx .x 


as the codeword polynomial. Note that the corresponding codeword is c — (1 1 ! 0i 
060) and encoding is therefore nonsystematic. 
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S is ei a Rem l 
w+ 13 S res AXIS XY +X —X-—i.: 
e (100 D, then Rx) =A +1 and this gives cx) = x" + x —x- l. Again 
wu 4 p> s Se _ NY z or E. 
Given à nonsi stema Oe codewx rd | à 
^ <8 vos v 
qus 8 





——— 


| . the set of codeword polynomials generated by c{x) = Axje(>). 
rable 3. Show ` he same set of codeword polynomials shown in Table 3.1, except 
c a A the polynomials occur in the tables is different. 
chat the order = : d ure for producing systematic codewords for cyclic codes is 
^ — plicated than that for nonsystematic codewords. Given an (z. $} 
slight) ea dimmi polynomial g(x), an information polynomial Ax) i5 
iu ioa systematic codeword using the following three steps 
eM ! 
| Multiph ax) by Y * to give 
(xp. 


* Divide ia^ * by g(a) to give the remainder 


r(x) = Raai]: 
3, Add na) to AN ` to give the codeword 
ex) = i(x)x*^ 4 rix). 3.11) 


Asan example, let's again consider the (7, 4) code with i= (0 1 0 1) and information 
polynomial ix) — x7 + 1. In Step 1, ix) is multiplied by x" * — x^ to give 


- — 2 3 E a 3 
(x) = (x7 + 1j = x) 4 xx. 


l S MD D ` ioi. d s 2 . ` à " ^ 
a NEP 2X x is divided by e(x) 2 x^ 4 x 1 which gives the quotient x^ and 
remainder x7, and so 


N Table 3.2 
polynomials generated by c(x) = v)gix) for the (7,4) code 
AX) 
: Axei) cix) 
: X —x-1 ex) 
"Mo 4x) 
ey | Pax 4. e +] wt 
E " 3, 2 een 
S . grate cáx) 
X* 4. x XYo-TX -x-1 Cáx) 
2 Pa uS, ! 
X rg] X LX +X4+xX cAx) 
x Yp HI cx) 
X y x* 4. x* 4. 3 $ 
1 X Xx ox) 
ax) 
calx) 
cs(xi 
Ca xl 
Ax} 
cxx 


€1 ix) 





lo give the codeword Polynomial 





n4 | i ye li codes 


"ur $ 
tnally i Sipji Vos d is added (o H (ua 


(x) = x | y | x? 


WW hiii Haast renphrinds {ir Les (oulewoid Ü 


(0101 100) and is the Systematic Codeworg 
fare (TON) 


Paanple VN 
Vea the (C74) eyele code determine the 


systematic codeword polynomials 
heey (LOOT) ard és (0L EEO) 


Ehe ibermation polynomial ford is (x) — 


$ — ; 
(€ | Land carrying out systematic 
CHOU gives 


Mep d Multiplying (s D by y” “= x’ gives x^ 4. x*. 


Stop P Dividing s" da^ by g() — x p x+ 1 gives the remainder rx) = x? + x, 


Mep Adding rs) to \" | c! gives efx) y" Ti pa” X, 


Hence the codeword is e- 


(1001110) which is the systematic codeword for 
(LO0d) 


bord, we pet ix) — v px 4 x and xx) = xf 4 x^ + x^, which when divided by 


vU gives r()— v^. Hence cl y) « x^ 4- x^ x^ +t x? and €— (1110100) (again 
encoding is systematic). [] 


Lets now consider why the three steps given produce systematic codewords, The 
rst step, multiplying (x) by x^ ^. shifts the information bits n — k places towards 
the leti hand side of the word, This leaves the k information bits in the correct 
position, required for à systematic codeword, and furthermore leaves space for the 
n k parity bits In the second and third steps the remainder r(x) of i( x)x" "* divided 


by c) i determined and added to Lox” ^. Using the Euclidean division algorithm, 
We Cin write 


((x)x^ " = q(x)g(x) + r(x) 


where q(x)is the quotient obtained when i( x)x" "is divided by g(x), Subtracting r(x) 


Irom both sides of the above equation, and remembering that polynomial sub- 
traction is the same as polynomial addition, gives 


f(x)" 4- rx) = q(x)g(x). (3.12) 


Now the term on the right-hand side of eqn 3.12 has g(x) asa factor, and is therefore 
“codeword polynomial, and so ((x)x" ^ 4. r( X) will also be a codeword polynomíal. 
Hence Steps 1, 2, and 3 give systematic codeword polynomials, Equation 3.12 shows 
that the codeword polynomial e(x) can be obtained by multiplying the quotient q(*) 


by g(x) instead of adding the remainder r(x) to Í(x)X""*, and so codewords can be | | 
expressed as 


c(x) = q(x)g(x) (3.13) 


for systematic encoding. In Step 3 eqn 3.11 could be replaced by eqn 3.13, however 
because polynomial addition is easier than multiplication itis normal to use egn 3-1! 
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han eqn 3.13. Nevertheless it is sometimes useful to thin 
tha j 
rather 


| k of Systematic 
ding in terms of eqn 3.13. Comparing eqns 3.9 an 
encodl 


d 3.13, we see that for an (n, k) 
ic code with generator polynomial g(x), the codeword Polynomial c(x) COrre- 
g - to the information polynomial i(x) is 
ondi 
: c(x) — f (x)g(x) (3.14) 
here f(x)=4(x) and f(x)=i(x) for Systemati 
where J^ 


tic and nonsy 


Stematic encoding 
ectively, and where q(x) is the quotient Obtai 
resp , q 


ned when dividing i by g(x). 
E — a and nonsystematic codewords for į =(0 1 1 1) given the 
Deter J 3 
(7,4) code with g(x)=x°+x+4+1. 


The information polynomial correspondin 


B to Lis ii) x^ Ex: 1, and so the 
nonsystematic codeword polynomial is 


c(x) = i(x)g(x) 
(x^ 4-x4- D x4 1) 
a gt a. i 


| 


For the systematic codeword polynomial we get 
Step 1: i(x)x"7^ — (x^ - ges I) x! 2.48 3 z* 
Step 2: r(x) = Boxer à! A+ x] =y, 

Step 3: c(x) = ipo". r(x) z x? +3443 +x 
The corresponding 


010) and (01100 
q(X) 2 x^ x, andr 


Systematic and nonsystematic codewords are therefore (0 l ` 
01) respectively. Note also that in Step 2 the quotient i 
eplacing Step 3 with c(x) = q(x)g(x) gives 


etx) = q(x)g(x) 
= (x7 + x)(8 4x41) 
=x vx ex 
aS given in Step 3, 


35 Decoding cyclic codes 


can be constructed 
We have already seen how with linear codes a syndrome table 
and used fo 


viewed in 
r error correction. Here the same approach n € horenie codes 
terms of Polynomials. The implementation of decoding a E sidered in Chapter 4. 
can be ac leved with linear-feedback shift register s, this 1s nd poly nomial of 
Systematic or nonsystematic encoding IS A <A factor. To test whether 
© always has the generator polynomial g(x) - codeword polynomial of 
“ty Polynomial v(x), of degree AS THEN, : (x) is determined. If the 
’"? Cyclic code the remainder of v(x) divided 5» ^ vise it is not. A code- 
emai €T Is Zero then v(x) is a codeword polynomial f : ws errors, and as with 
?'Ynomia] will only give a nonzero remainder if it i 


ether 
4 Cyclic coq 


‘ome arbitr 
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linear codes an error syndrome can be defined as that depends solely on the Presence 
of errors. The syndrome polynomial of v(x) is defined as | 


s(x) = Rgcoj[v(x)] 


(3.15) 
recalling that the notation on the right-hand side denotes the remainder Obtained 
when v(x) is divided by g(x). For a codeword polynomial c(x) 


Rex|e(x)] = 0 (3.16) 


because c(x) has g(x) as a factor and therefore the syndrome polynomial of a 


codeword polynomial is s(x)=0. If v(x) represents a codeword polynomial c(x) 
containing errors then 


v(x) = c(x) + e(x) 


where the error polynomial e(x) is the polynomial representation of the error pattern 
Using eqn 3.15 the syndrome polynomial is 


s(x) = Rox) [¥()] 
= Rgwle(x) + e(x)] 


= Rex) (e(x)] + Rox) le(x)] 
and using eqn 3.16 gives 


s(x) = Raw [e(x)]. (3.17) 


Therefore, the syndrome polynomial depends solely on the error polynomial and - 
not on the codeword polynomial incurring the errors. From eqn 3.17 a syndrome 
table, giving the syndrome polynomials of all the correctable error polynomials, can 
easily be constructed. 

As an example, let’s construct the syndrome table for the single-error-correcting 
(7,4) code. We need to determine the syndrome polynomials for the 7 single-error 
patterns (0000001), (0000010),...,(1000000). Starting with (0000001) the 
corresponding error polynomial is e(x)=1 and using eqn 3.17, with 
g(x) 2 x^ -- x - 1, gives the remainder r(x) = Ræ+x+1ı[1]= 1 and therefore the syn- 
drome polynomial is s(x) 2 1. The error pattern (0000010) gives e(x) 2 x and 
syndrome polynomial s(x)— x, and continuing through to (1000000) gives 
e(x) = x? with s(x) = x? + 1. Table 3.3 shows the resulting syndrome table. The table 
is equivalent to the syndrome table previously given for the (7, 4) Hamming code (see 
Table 1.7), except that here we have a polynomial representation of error patterns 
and error syndromes. Either table can be converted into the other simply by chan- 
ging to or from a polynomial representation, as required. It is instructive, howeveb 
to see the construction of Table 3.3 from the perspective of cyclic codes and not just 
by a change of notation. 

Error detection and correction is carried out in a manner similar to that already 
described for linear codes. Consider a codeword polynomial c(x) incurring an erro 


polynomial e(x) such that the input to the decoder is v(x) . The syndrome polynomia 
5(x) 18 determined using s(x) = Reco[v(x)] and the error polynomial, denoted by € (x); 
corresponding to s(x) is read from the syndrome table. Adding é(x) to v(x) gives 


C(x) = v(x) + é(x) (3.18) 


— 
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Table 3.3 
Syndrome table for the (7, 4) cyclic code 
aa TS tatimtHpHIMSM RT m E 


y e(x) s(x) 
- een TOOL EREMO. A ML COMMO M 
i0 0 0 0 0 O 0) 0 0 
09000001) 1 1 
0000010) x x 
(0000100) x x 
(00010090) x x41 
(001000 0) x xax 
(0100000) x xY-x41 
1000000) x? x*4- 1 





as the estimated codeword polynomial for c(x). If the number of errors in e(x) is not 
greater than the error-correction limit of the code then é(x) = e(x), c(x) = c(x) and 
decoding is correct. As already mentioned for decoding linear codes, the use of a 
syndrome table is not always practical, especially for codes with large blocklengths 
and information lengths. Furthermore, with cyclic codes this approach does not 
utilize the cyclic nature of the codes. In Chapter 4 we consider the implementation of 
encoding and decoding, using linear-feedback shift registers, and we will see how the 
cyclic property of the codes is utilized. 


Example 3.10 
Consider decoding when the codeword c— (101001 1), belonging to the (7.4) 
code, incurs the error e— (1000000). 


The codeword (1010011) gives c(x) 2 x8 + x* &- x - 1 and e —(1000000) gives 
e(x) — x". Hence the word to be decoded is 


v(x) = e(x) -- e(x) =x* -- x 4- 1. 


Thegenerator polynomial for the (7, 4) code is g(x)— x? x4 landthe syndrome 


polynomial is 
R s(x) " Ro c [x4 ^x 1] = x +1. 
eferring t 5 
a(x) = 8 to Table 3.3, we see that 5(x) = x^ + 1 corresponds to the error polynomial 


= gl 
X*. ] i 
herefore the estimated codeword polynomial is 


C(x) = v(x) + e(x) 
i x4 1) 4- x$ 


6 , 4 
=X +x°+x+4+1 
which gives ¢ — 


l 
was the codewon, 010011). The decoder therefore correctly concludes that v 


d (101 
0011). E 


46 F 


actors of x^ 44 


ask wheth 
era | ; 
What char ae can be used to generate a cyclic code, and if 
ics must a polynomial have such that it can generate a 


n 
ac 
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cyclic code. The answer to this question lies in the factorization of the 
p(x) 2 x" -- 1. Mial 


| (3.19 
A polynomial g(x) with degree r generates an (n, k) cyclic code, where 4 | 
g(x) divides x" 4- 1. Note that by 'divides' it is implied that the remainde Snap ip 
so g(x) has to be a factor of x^ + 1 if it is to generate a cyclic code. C T 1S Zero 


| onsi j 
code with g(x) = x^ + x + 1. In Section 3.1 it was claimed that the (7 "- i the (7, 4) 
and examples of cyclic shifts were given. This though does not prove that " IS Cyclic 

e 


cyclic but only illustrates the cyclic relationship between some of 
show that g(x) generates a cyclic code we need to divide x’ + 1 by £(x) and ch 
the remainder is zero. Dividing x’ + 1 by g(x) gives Eck that 


Code jg 
Its codewords To 


x! Fx -x-4l 
x +x+l)x +l 
x! 4 x xt 
xx 
tr + x 
x*"4x4] 
0 


and so the remainder is zero. Hence, the polynomial g(x) — x? + x 4 1 divides x’ 4.1 
and therefore generates a (7, 4) cyclic code. Note that the degree of g(x) is r=3 and 
so the information length of the code is k=n—r=4. Furthermore the quotient 
obtained is x* + x? + x +1, and if we let h(x) 2 x* +x? 4- x - 1 then ` 


g(x)h(x) =x +1. (3.20) 


From eqn 3.20 we see that A(x) also divides x! + ] and therefore h(x) 2 x! x4 
x + 1 likewise generates a cyclic code of blocklength 7 but with information length 3 
(because the degree of h(x) is 4). Hence the polynomial x* 4 x^ + x 4- 1 generates a 
(7, 3) cyclic code (note that h(x) is referred to as the parity-check polynomial of the 
(7, 4) code, this is considered further in Section 3.7). 

We can goa step further in factorizing x’ + 1 because x = | isa root of h(x) (letting 
x= l gives h(1)=1+1+1+1=0) and so (x + 1) is a factor of h(x). Dividing h(x) 
by (x+1) gives the quotient x?’ +x?+1 and a zero remainder. Therefore 
h(x) 2 x* - x? - x = (x^ 1) (x? +x74+1) and substituting this into eqn 3.20, 
along with g(x) =x? + x + 1, gives 


(x IOP x? + IOP 9 x 1) 2 x' 41. (3.21) 


There are no other factors of x’ +1 as neither x? +x? + 1 or x? - x | can be fac 
torized. Any of the 3 factors of x7 -- 1 or products of the factors will generale ê 
cyclic code with blocklength 7. Equation 3.21 therefore shows that there joel 
polynomials that generate (7,4) codes, the polynomial x! x1 that we “a 
already considered and x? + x? + 1 (the codes are however equivalent). Taking 





p" 
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Table 3.4 
Cyclic codes constructed from x’ + 1 

s 
Factors g(x) (n, k) code 

CA ÁÁ——À— —— BRE 

(x) X+ 1 UJ, 6) 
prs x x1 (7,4) 
LX) x! +x+1 (7,4) 
Ko) fox) XA exl (7,3) 
AGO) — xo bx AX + (7,3) 


ANHA) K - x? x8 ob x? ex? 4 x1 (7, 1) 


Note: x 4-1 fi) fa S 


product of the factors (x + 1) and (x? +- x + 1) gives 


(x D) x41) = x* x +? I 


which generates a (7, 3) cyclic code and is equivalent to the (7, 3) code generated by 
x5 x +x + 1. The product of GC +x+ 1) and (x? + x? 4- |) gives 


(3 -- x D) 4- x* 1) m x9 4+ 04x44 x^ ax I. 


This has degree r — 6 and so the cyclic code constructed has k= 1 (recall that 
k=n — r) and is therefore the (7, 1) repetition code. The code is clearly cyclic, as a 
cyclic shift on either of its 2 codewords, (0000000) or(1 11111 1), gives the same 
codeword. The factor (x + 1) taken on its own generates a code with k — 6 and 
therefore gives the (7, 6) single-parity-check code. Again this is clearly a cyclic code 
because a codeword that is subjected to a cyclic shift preserves its parity and is 
therefore still a codeword. Note that 3 factors give 8 different combinations, of 
which we have seen 6 (giving the two (7, 4) codes, the two (7, 3) codes, the (7, 1) code 
and the (7, 6) code). The remaining 2 combinations give 2 trivial codes with g(x) = | 
(and n — k — 7) and g(x) 2 x! -- 1 (with n=7 and k — 0). Table 3.4 shows the 6 
nontrivial cyclic codes that can be obtained from x’ + 1. 


Example 3.11 


Given that x°+1= (x 4-1) (x^ - x 4 1) (xf +x? + 1) determine the cyclic codes 
with blocklength 9. 


Let the individual factors be denoted by 
f(x) =x+1 
f(x) =x x41 
f(x) =x - x5 4 1. 
H - 
ere fi(x) =x + 1 has degree | and therefore generates a (9, 8) single-parity-check 


cod 
(he dirus: 2(x) and f. 3(x) generate (9, 7) and (9, 3) cyclic codes respectively. Taking 
uct of f(x) with (x) and then with f(x) gives 


A (x)fa(x) =x +1 
Which Ai(x)fs(x) = x! + x8 + x44 x1 
IC i 
ive (9, 6) and (9, 2) cyclic codes respectively. 


ioo 
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The product of Aliy) and (vy) gives 


f(x) AQ) um XN" o4 x" ud. x | v | \" | n | \? ba 7 
which has degree S and therefore gives the (9, 1) repetition code 
This accounts for 6 codes, the remaining 2 codes are - 


i Lriviul ! Te 
sk=9 and av =v + b(n 9, k = 0). codos WIR gy. 


|] 


3.7 Parity-check polynomials 


It gix) is the generator polynomial olan on A) eyelie eode, then ihe polynomi | 
TI | 
that satisties HAC) 


"E H 
RINIA) 9 x^ 4 | (42) 


is known as the paritysclieck polynomial of the code, and rearranging this gives 


oc)! ade | 
hiv) EC (3.23) 


The degree of ACY) is n minus the degree of wv), and as pex) has degree n kihe 
parity-check polynomial Aty) therefore has degree n- (u K) = k. The parity-check 
polynomial ean be written as 


hiv) = hyn’ 


FA nhl pe cee Ex te py te Ao (3,24) 
where the coefficients Ap — A, — | and the remaining coefficients An, lay. thee 
hy, are Q or I. The (7, 4) code with giv) s v pv E has the parityscheck poly 
nomial (X) = (vo + Doe Hak D) which gives 


A(x) = x* 4 x9 x IN, (325 


The parity-check polynomial is analogous to the parity-check matrix // used i 
linear codes, just as the generator polynomial is analogous to the generator matri 
G. Note however that we have already considered the decoding of cyclic codes, " 
as we saw this can be achieved using the generator polynomial (the parity-che 
polynomial was not required for decoding the (7, 4) code). The relevance of the 
parity-check polynomial to decoding is considered later, In Section 4,9 we "-— 
how the generator and parity-cheek matrices can be obtained directly from ! 
generator and parity-check polynomials respectively. " 
t is interesting to compare the relationships between codeword, generalon i 
parity-check polynomials with that of codewords, generator, and pans 
matrices (used in cyclie codes and linear codes respectively). First conside sit 
construction of codeword polynomials, We have seen that the codeword polyno 
c(x) for an information polynomial i() is given by 


o(x) = i(x)g(x) 
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be compared to c— iG used to construct the codeword c, given an 
n word i, of a linear code with generator matrix G (note that whilst 
) gives nonsystematic codeword polynomials, systematic polynomials 
iso contain g(x) as a factor). To see the relationship of g(x) to A(x) 
d to that of G to H (the parity-check matrix of a linear code), we consider 


compare divided by x" + 1. This gives a zero remainder and so 


Ryn 1[g(x)h(x)] = 0 (3.26) 


hich can be likened to GH’ =0 given previously for linear codes. Multiplying 
(x) = cog Q9 by h(x) gives c(x)h(x) = i(x)g(x)h(x) and using eqn 3.22 we get 
ia) n(x) = ico + 1). Dividing this by x” + 1 gives 


Ry [c(x)h(x)] = 0 (3.27) 


which can be compared to cH! =0. Moving on to error syndromes, the syndrome 
polynomial s(x) Is given by 


s(x) = Rec |v(x)] 


and this can be likened to the definition of an error syndrome, in a linear code. 
s— vH! of a word v. Note here that there is a difference between the expressions for 
s(x) and sin the sense that s(x) depends on the generator polynomial while s depends 
on the parity-check matrix. However, the syndrome polynomial s(x) can be 
expressed in terms of the parity-check polynomial as follows. The syndrome poly- 
nomial is obtained by first dividing v(x) by g(x), and then taking the remainder. 
However, from eqn 3.22, we have g(x) = (x" + 1)/h(x) and therefore dividing by g(x) 
is the same as multiplying by A(x) and dividing by (x” +1). Hence the syndrome 
polynomial can be obtained by multiplying v(x) by A(x), dividing by (x^ + 1) and 
then taking the remainder, so that 


s(x) = Rei[v(x)h(x)] (3.28) 


and we see then that s(x) can be expressed in terms of h(x). Furthermore, we can now 
see why g(x) and not A(x) is used for decoding cyclic codes, it is easier to divide v(x) by 
8(x) and then take the remainder, rather than first multiplying v(x) by A(x), dividing 
by (x" + 1) and then taking the remainder. Table 3.5 summarizes the comparisons 
made between c(x), g(x), h(x), c, G, and H. 


Table 3.5 
Comparison of c(x), g(x), h(x), c, G. and H 
Linear codes Cyclic codes 
c= iG c(x) = i(x)g(x) 
GH" =0 Rig OA] =0 
cH = Ry ac(x)h(x)] = 0 
s=vH s(x) = Ryn s[v(x)h(x)] 


(s(x) = Ral) 





in 
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3.8 Dual cyclic codes 


The parity-check polynomial A(x) of a code C can be used to 
reterred to as the dual code of C. This is achieved by 


polynomial h* (x) of A(x) as 


where r is the degree of A(x). The reciprocal polynomial forms the 
nomial g(x) of the dual code and therefore 





; generate another e, 
irst defini 
ng the FéCipro, i 


h'(x) = x'A(1/x) 


g(x) = h (x). 


Replacing each x term in A(x) by 1/x and then multiplying through by x’ has the 
effect of reversing the order of the coefficients of A(x) . So, for example if 


h(x) = hy) + hx? + hx + ho 


give 


è . 1 . 
and multiplying by x^ gives 


then the corresponding reciprocal polynomial is obtained by replacing x with I /x. 9 


h ( 
X 


h'(x) = hi; + hix + hyx^ +h 


h^ 


h 3 
wx x 


h 
+— + ho 
x 


^ 
- - 


Rearranging the order of the terms on the right-hand side gives 


h'(x) = hx? + hix? + hax + hz 


and comparing this to A(x) we can see that the coefficients of A*(x) are in the revers 


order to those in A(x). 


Consider the (7, 4) code with parity-check polynomial A(x) = x* +27 + x+ 1. TE 
reciprocal polynomial is given by 


h'(x) 


which gives 


g(x) 2 x* - x? x^ 1 


as the generator polynomial of the code that is dual to the (7, 4) L 
length of a code and its dual code are the same, so the dual code has plockleng!? 

The degree of g(x) is 4 and therefore the information length of the dual 
(recall that the degree of a generator polynomial for an (n, k) cyclic 
Hence the code that is dual to the (7,4) cyclic code is a (7.3) code. 





x*h(1/x) 


x LU IS 
 Ax* x* x 


lx p 


(3.30) 


code 5? 
code is P 
The C? 


(3.29) 


generator poly. 


a daci ST men * 





m 


TULL ted here in clearly the UA, 3) eye code with ua): A T 
Lin Section NT Hyntemialle codewords penerted hy p) - J ! 
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| 
| à 


code (UH 
conside! e 


re piven te pable LOH) 
i a 


|L is interesting tO consider the code generated by the piriby-cheek polynomial 
hv) Taking the partly check polynomial ol ihel 1, Ajeoue lit |) yA | (^ Led lagy 
generate polynomial given Lye systematic codewords showin in Table 4600). This is 
ihe qme set af codewords penerated hy (n) akeepli ihal the order ol the bits ure 
reversed. Pai licodeword in Table Lata) corresponda to i codeword in Table $6), 
bur with the bits reversed. Por example the Jnd codeword (0014 TOT) in Table 
pala) nm the 6th codeword (LO TE LOO) in Table 60) with the bits reversed, 
Likewise the d codeword (TOOT TT) it Table 366) corresponds to the fist 
codeword (EE E00 10) ut Table 36b), Hence ench codeword Gu, 6p, Cn Ces Ca) Cod 
produced by AC has an equivalent codeword (lalh 64, Pu Cn Ep Cy) produced by 
hii v), ad so ihe codes produced hy f Cobwmd Ady) are equivalent, His tor this reason 
(hat the parity check polynomial is ollen aid to genere ihe dual code hut, strictly 
speaking, Hts the reciprocal polynomial Ai^ (x) Ud generales the dual eode, the code 
generated by HA) fn equivalent to the dual eode. 


Example 5.12 
Given the (9,60) eyehe code with generator polynomial g(x) = 4 1 eonstruet its 
dual code 


The parity cheek ploynomial of the (9, 6) eode is given by M) (0 d JI v 4 1) 

i i { i , 
xt p Prom Aic) the reciprocal polynomial is obtained by replacing x by 1/3 
and multiplying by wo nu 


i | | 
hs) UET i | J alex’ 4s 


and the generator polynomial of the dual eode is therefore 
( { 
g(x) sx dx k T, 


l he blocklength of the dual code is 9 and given that the degree of gix) is 6 then the 
monate length js 3. Therefore the code thal is dual to the (9, 6) cyclic code n the 
(9, 3) code with g(x) v ae x^ a T. z 


Table 3.0 
The (7,3) codes generated //(«) and fit) 


gp -WG)y-x abad — (uad soe rr d 


(0 00000 0) ) Q O00 0 0) 
(0 FL 10 p) uy O POT P b 
(0 10011 I) (0 10 V 10) 
: i IO | 0) () 1 1 1OO FJ 
dH (oto 

)0 | f) 4011100) 
( /(£0100 1) 4100101 


110101040) 4110010) 





= 


3.9 Generator and parity-check matrices of cyclic Codes 
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The generator matrix and parity-check matrix of a cyclic code can be obi; 

directly from the code's generator polynomial and parity-check polyn : tained 
spectively. The generator polynomial of an (n, k) cyclic code ig given b mial te, 
namely y eqn 3, 


g(x) = Bnk Ó + Bag tr! H e + g + Bix + go. 


The corresponding generator matrix G is a k by n matrix whose first row contains 
the n — k+ | coefficients of g(x) followed by k — 1 zeros. The second row of Gis 
obtained by shifting the first row one place to the right and placing a 0 in the position 
vacated on the left-hand side. The third and subsequent rows are likewise cop. 
structed by shifting the previous row by 1 place to the right and placing a 0 in the 
vacated position. This is continued until all the k rows are filled, at which point the 


coefficient gy = | will be at the far right-hand side of the bottom row. The resulting 
matrix is 


Én-k  £n-k-] -— £2 gi £0 —- 0) 
() En-k . Én-k-| p 22 1 £0 0... 0 
G 
() () Tonk | Rank| 22 £i go 0 
() — () £n—k HB u-R-i TT gQ - 8E £9 
(331) 


The (7,4) Hamming code has generator polynomial g(x) 2x +x+ |, and so 
g= 1,270, g; = | and go — 1. Hence its generator matrix is given by 


£: 22 £& g 0 0 0 
Ü s 0 g3 82 E £0 0 0 
0 0 gz g g go 0 
0.0 0 gs go g Bo 


and substituting the values of g3, g2, g1, and go gives 





0 
0 
l 
l 


— á CD = — 
on = © 
= OO oO 


| 
0 
| 
0 


O O Oo = 
e Oo = © 


i um ; i change? 
[he resulting generator matrix is in a nonsystematic form, but can be y^ ro 
to a systematic form using elementary row operations (see Section 5.5). | 





— ni 
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3 and 4 to row | gives 


100 011 0 I 
0 1 6 111 09 
Geilo 8-1 9|1.1 0 
0 0 0 110 1 1 


here the matrix is now shown to be augmented. Adding row 4 to row 2 gives 
wher j 


1 00 0/1 O0 | 
[0 10 0ft 1 1 
"= jog 1 0|1 10 

000 1/0 1 1 


which is the systematic form of G given in Section 2.2. 

We have already seen how to obtain the parity-check matrix H from G, let's now 
consider how H is obtained from the parity-check polynomial A(x). The parity-check 
polynomial of an (n, k) cyclic code is given by eqn 3.24, namely 


h(x) = yx + hy ax* + + Hx + hix + ho. 


The parity-check matrix H is an n — k by n matrix and is constructed in the same way 
as the generator matrix, except that the polynomial coefficients are in the reverse 
order. Therefore the first row of H contains the k + 1 coefficients of h(x), starting 
with iy and ending with hy, followed by n — k — | zeros. The second and subsequent 
rows are constructed by shifting the previous row by | place to the right and placing 
a 0 in the vacated position. This is continued until there are n — k rows, at which 
point the coefficient A} = 1 is at the far right-hand side of the bottom row, and the 
resulting matrix is 


ho hy I» im^ kai "m Ur 0 
0 ho hy h Lu P Ui -One c 
H = (3.32) 
D ae. d lio hy hy "T I il hy. 0 
() om Q hy hy ho TE "m «| lik 


The paritv-chec — 
"ài a matrix for the (7, 4) code has n — k = 3 rows and n = 7 columns. We 
ready seen that the code’s parity-check polynomial is A(x) =x" 4- X^ + 


X l, and so /ij — |, hy = m . : 
matrix is given n ; Aj =l, Ir) m l, I 0, and A4= 1. Therefore the parity-check 


hy h | h ’ h 4 hy () () 
H — |0 hg h m hy h O 
0 0 ho h | h 2 hy hg 








96 | Cyclic codes 


and substituting the coefficients gives 


I1 1 U | 9 D 
Hi ! L 1 9g 1 O0 
0.0 1 ] 1 0 1 


Recall that in its systematic form, H is an augmented matrix with the identit 
on the right-hand side. To change H to its systematic form simply require 


y matrix 


i S adding 
row | to row 3 to give 
t 1] 1 0/11 0 0 
Hst | 1 Liv 1l 0 
Il 1 0 1/0 0 1l 


which is the parity-check matrix for the (7, 4) code as given previously. 


Problems 


3.1 Show that the following linear codes are not cyclic 
(a) the (6, 3) code given in Table 2.2 
(b) the (5, 2) code with generator matrix 


3.2 Given the two polynomials pi(x) 7 x* -- x 4- 1 and p(x) 2 x? + x^ +1 find the 
quotient g(x) and remainder r(x) of p2(x) + p(x). Check your answer using 
the Euclidean division algorithm. 

3.3 Show that 
(a) x^ 4 x* --x--12 0 modulo-(x 4- 1) 

(b) Rcs [C ox à 0 x =x. 

3.4 Given the (7,4) cyclic code with g(x) — x^ -- x - 1 determine systematic and 
nonsystematic codeword polynomials for the information polynomial i(x) = 
x^ +x? +x + 1. Show that the systematic codeword can be obtained using the 
quotient of x^i(x) + g(x) instead of the remainder. 

3.5 The codeword polynomials x* + x^ + x? + x and x? + x? + x^, belonging to the 
(7, 4) code with generator polynomial g(x) = x? + x + 1, incur the error pattern 
e(x) = x^. Show that the resulting syndrome polynomials are the same. 

3.6 A codeword polynomial c(x), belonging to the (7,4) code with g(x)=* t 
x+ 1, incurs errors so giving the received polynomial v(x). Find c(x) when 
(a) v(x) Lx) 4. x* + | 
(b) v(x) = x8 + x? + x. 

3.7 Given that 


x + |= 
(x + 1)(x? +x + 1)(x4 + x4 1)(x4 a xà ue DG ox) xà xD 
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Á ` 
A ihe number of evelic codes with blocklength 15 
M the aumber of (LSU) cyclic codes 


i x he generator polnomitals | or the (15, 7) cyclic codes. 
D polynomial v + 1 can be factorised as 
RN 


a a. E 3 2 
X 3 | e QI > D VoM x" TX +X +X + 1). 


RST the generator matres for the codes generated by (x+ 1) and 


re ex exte via x^ x Dy and show that the polynomials generate the 
(7.8) single pants check code and the (7, D) repetition code respectively. 


i3 Determine the panty-eheck polynomial of the (15,5) cyclic code with 
generator polynomial 


g(x) = x? 4 x 4 4 + x" TEE. 


Hence find the generator polynomial, the blocklength and the information 
iength of the cycle code that is dual to the (15, 5) code. 








‘incendie haa diet anemia en e e er 
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Linear-feedback shift registers for encoding and || | 
decoding cyclic codes : 


———— 


Cyclic codes and linear-feedback shift registers lend themselves to si 
matical treatment and as we shall see the encoding and decoding of Cy 
be realized in terms of linear-feedback shift registers. The task is si 
fact that part of the decoding circuit is the same as that of the encoding Circuit, this 
being the polynomial-division register. As we shall see, once the polynomial-divisio, 


register is established, it is relatively simple to construct circuits for encoding and fo, 
decoding. 


milar mathe. 
clic Codes Can 
mplified by the 


4.1 Linear-feedback shift registers 


Figure 4.1 shows an r-stage shift register capable of storing r bits in its Stages 
bo, bi, ..., b, ,. Each stage is a 1-bit memory element which, when shifted, forwards 
its contents to the next stage and is then updated by the contents of the previous 
Stage. Each time the register is shifted a bit bin enters the register and all the bits in 
the register move along by one stage, with the bit in the last stage b,. , leaving the 
register and forming the output dou. At each shift the contents of the ith stage is fed 


to the (i+ 1)th stage and then the ith stage is updated with the contents of the 
(i — 1)th stage. This is expressed as 


bi, = bi (4.1) 
b; = bi- 


where b; is used to represent the ith stage or the contents of the ith stage (this should 
not cause confusion). 

The order in which the two expressions in eqns 4.1 are carried out is significant. lf 
the order is reversed, so that the stage b;is first updated with the contents of 5;-1 and 
then b;+ı is updated, the original contents of b; will be lost and 5;,, will end " 
containing the contents of b; ,. For an r-sta ge shift register eqns 4.1 can be extende 
to the whole register to describe the changes in the stages at each shift, this gives 





bout es D, 
b, = b, 2 
à (4.2) 
b, = bi 
b, — bg 
bo = bin 


tively: 
where bin and bouw are the bits entering and leaving the shift register nr gister 
Equations 4.2 describe the operation of the register and give the state of the 








El 
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> L4 5. ——» —— 4.4 f 
Dn D- | | 9*1 | 2o i — »5 b, 


Fig. 4.1 An r-stage shift register. 









F7 5r] LT a b L 7 
2 LT A9 
| — d 1 | 
Fig. 4.2 An r-stage linear-feedback shift register. 
5, 






(te > b. pay b. — + b. LL... | 


—— —— 


Fig. 4.3 An r-stage LFSR with feedback to all Stages. 


al each shift. The Stages b, and b 
sides of the register respectively. 

Ina linear-feedback shift register (LFSR) the output bow iS fed back into the 
register. The simplest example of such a register is shown in Fig. 4.2 which consists 
Ji r stages. Here the output bit is fed back into the first stage b, and so the stage 
Contents are cyclically moved around the register as the register is shifted. If the 
sages are initialized with a codeword c from a cyclic code of blocklength r, then r — | 
shifts wili Produce ther — | codewords that are cyclic shifts of the codeword c. At the 

shift the Stages will again contain c. 

The feedback within a register can be used to alter any of the stages directly and 
Dot just by. Figure 4.3 shows a linear-feedback shift register with r Stages and 
“ek, via modulo-2 adders. to all stages. Each modulo-2 adder has two. or 
“ore, inputs and One output that is the sum modulo-2 of the inputs. In pracuce 
me stages will have Ieedback and others will not, depending upon ae meen 
Denoting the feedback bit by 6; then stages with a feedback link change according to 


--1 are referred to as the low-order and high-order 


mum (4.3) 
here addition is modulo-2. and 

44) 

b; = b; , a 


bes Changes to Stages without a feedback link. 





000 
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Example 4.1 | 
Figure 4.4 shows a LFSR with 5 stages and feedback to 3 of the stages, T 
operation of this register is given by - The 


Dou = Oy = bg 


b4 = b; 
bi = hy + by 
by = by + by 
b, = bo 


by = bin + br. 


Table 4.1 gives the operation of the register when the input is the 10-bit word (1 0 
1010001 1) and where the left-hand bit enters the register first. The Stages are 
initialized to zero before the first bit enters the register. For the first 5 shifts the 
feedback is zero as the input has vet to reach the high-order stage b4, and so at the 
end of the 5th shift the stages simply contain the first 5 bits of the incoming word 
(for clarity these are underlined). It is only when the first nonzero bit reaches the 
high-order stage that feedback begins. At the end of the 5th shift we have by=| 
and therefore at the next shift 5; — 1 and there is feedback to b3, ba, and bo. Once 


all the bits have entered the register, the final state of the register is (0 0 1 00) (also 
shown underlined). 0 





Fig. 4.4 A 5-stage LFSR. 


Table 4.1 
Step-by-step operation of the LFSR in Fig. 4.4 





Inputv-(1010100011) 


Shift bin bo b, b> b, b4 be 
0 O 0 O 0 O  -—lnitial state 
1 1 1 0 6 6 9 0 
2 0 0 1 0 0 0 0 
3 1 1 O0 1 O 9 0 
4 0 0 1 0 1 oO 0 | 
5 1 1 O i1 9 1| 0 | 
6 0 t 1 1 0D 6 1 i 
7 0 0 1 1 1 0 0 | 
8 0 0 0 1 1 1 0 i 
9 1 O oO 4 O 1 1 
10 OO $ed 


«—Final state 1 
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The polynomial-diviston register 
4.2 oding and decoding of cyclic codes involves the division ofa polynomial p(x) 
The enc ait polynomial g(x) giving a remainder r(x). When encoding, p(x) is an 
by à ee p olynomial i(x) and r(x) gives the parity-check bits required to con- 
informa : ewords. At the decoding stage p(x) is the received polynomial v(x) and r(x) 
NE drome polynomial. Encoding and decoding use the same polynomial- 


| ives the syn 
| um register and SO we consider this before addressing encoding and decoding 
| I! 


| specifically 
| Figure 4 
| | polynomial 


5 shows a linear-feedback shift register for dividing an arbitrary 


p(x) a a g + Pn—2x"* pi + pax + Pix + po 


| by a fixed polynomial 
g(x) = 8X  giax | +++ + Box? + gix + go 


where p(x) and g(x) are referred to as the dividend and divisor respectively. The 
| switches in Fig. 4.5 represent the polynomial coefficients g; and are open or closed 
| depending on the coefficients. If g; — 1 then the corresponding switch is closed so 
giving a feedback link to the ith stage, and changes in the ith stage are given by 
bi= b, + br (eqn 4.3). If g; — 0 then there is no feedback to the ith stage, the adder 
feeding into b; can then be omitted, as it has only | input, and so 5; — b, , (eqn 4.4). 
The feedback link g, is always present in the register, as a polynomial g(x) of degree r 
has g, — by definition. 
M ud nie coefficients p; are shifted into the register starting with the 
shirt pne gi Pn—1, followed by p, 5, Pn—3 and so forth. For the first r 
Wades back and output are zero as the dividend has yet to reach the 
edis: co age b, ,. Once the first nonzero bit of the dividend reaches 5,. , 
m n" and Lin at this point that division starts. The high-order 
that apt «€ an x term within p(x), and a 1 leaving this stage means 
| feedback circuit 2 to be subtracted from p(x). This is achieved by the 
| analogous to the - ose links to the stages represent the divisor g(x). This is 
carrying out lon p in which the divisor is subtracted from the dividend when 
Place. On dase - If the output of by. IS Zero then no subtraction takes 
by &(X) is left ; £ the last bit po into the register the remainder of p(x) divided 
n the stages. Note that because the stages bo, b),...,b--2,5,-—| 


9o g, 


b. 
P(x) 2 





Hahah... 
Fig, 4.5 


D pol . * ie 
YNOmial-division register. 





E a 
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contain the remainder of the input divided by g(x) we ref 
remainder stages. If we let T fo ther 4 the 
ríx) = uas 7 b,_>x7~? eee t bs x 4. bix + p, 
de. 
be a polynomial representing the stages then, using the Notation ; 
Section 3.2, we have Mr Oduced j 


r xj "S R, x)| P(x). 


Furthermore. the output from the register gives the quotient YX), where t 
nonzero output determines the degree of gix). Let's consider dividing the fing 


- " » 
px)j—x + ex 4x4] 


The coefficients of the divisor gix) are g4= 1. g3=0, g=], £i =0, and g,- 1 Th 
ünear-teedback shift register required is shown in Fig. 4.6. The dashed lines show the 
absence of feedback links due to g; = 0 and g, = 9. With each shift the Stages chang: 
according to 


boa = b; = b: 


b; = b; 
b: = b; + bs 
b; = by 
bo = ba + br. 


The coefficients of the dividend are p; — 1, pg— 1, ps =0, p,—0, p3=9. p=! 
p; = l. and p, = 1, and these enter the register high-order bits first, p- followed DY Ps 
and so forth. Table 4.2 shows the division step-by-step for all the 8 shifts required 10 
feed pix) into the register, the polynomial representation of the remainder Stages. 
rix). is also shown in Table 4.2. The input is underlined for the first 4 shifts so 
can clearly see its progress into the register. It takes the first 4 shifts to move p7 y» 
high-order stage b+. during this time there is no feedback or output. On the ue 
p- leaves b; therefore giving a nonzero feedback and output, so that =! 4 
5... — l, division has now started. By the end of the 8th shift all tbe 
coefficients have entered the register and the stages contain the 


r(x) — bix + bx + by x + bs. 





Fig. 4.6 An LFSR for dividing by x*- x^ +1. 
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Table 4.2 
Operation of the LFSR in Fig. 4.6 


mee. RN i » 
boti byas 45741 


ding v  deX dX 
Dividing X 7 


aa m E 





| 1 0 0 @ 0 | 
: | 1 p 0 0 0 V+] 

. 0 0 1 1 OQ O vex 

, 0 0 0 1 1 Q wp? 

i Q l 0 1 | 1 x* 4 x* 41 
6 0 | 1 1 | x^ xt hx 
3 | 0 0 0 | | x 

8 l 9 9 1 0 1 oor 





As we can see from Table 4.2 (last row, underlined) only ^» is nonzero and 
therefore r(X) — A^ is the remainder of p(j3) — x^ x9 4 +441 divided by 
gx) 2 x! x 1. Furthermore the register output is (0000 1 1 1 1) which gives the 
quotient g(x) — x^ + A7 + x + 1. We can check the answer by constructing p(x) from 
rx), g(x), and g(x). Using the Euclidean division algorithm 


P(x) = q(x)g(x) + r(x) 
and substituting g(x), g(x), and r(x) gives 


(+e ext DG pae 
=x! 4 x8 s +x+ ] 


P(x) 


as requi j — WT à; 

i a . 2 We could have checked the answer by dividing p(x) by g(x) using the 

licatie son method, however the Euclidean division algorithm involves multi- 
n, and not division, and is therefore a bit easier. 


Example 4.2 


Y consideri 
remainder oa : Step-by-step operation of the register shown in Fig. 4.7 find the 
xil quotient when the input to the register is p(x) 2 x8? Ok 


From Es 
8. 4.7 
as depres 3 E ve see that the register has 3 stages and therefore the divisor 
Sdback links vis of the form g(x) = x? + gy? + g1X + go. Stages by and 5, have 
P npa e zm b» does not and so gy = gı =l, g>=0 which gives g(x) = 
© divisor. Also from F ig. 4.7 we get 


bout = bp = b» 
b; = b 
b, = bo + by 
b, = bin + by. 


nm 
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Fig. 4.7 An LFSR for dividing by g(x) 7 x^ 4- x 4 1. 


Table 4.3 
Operation of the LFSR in Fig. 4.7 





Dividing x? -- x2 4- x* 4 x 1 by x^ x4 1 





Shift bis bo bi b» br r(x). 
0 0 0 0 0 

1 1 1 0 0 0 1 

2 1 1 1 0 0 x41 

3 1 1 1 1 0 x 4x41 
4 0 1 0 1 1 x* 41 

5 0 1 0 0 1 1 

6 1 1 0 0 x41 

7 1 1 1 1 0 x! x41 


Table 4.3 shows the step-by-step operation as p(x) enters the register. After "Ir 
shift p(x) has completely entered the register, and the remainder stages E 
giving the remainder r(x) 2 x? 4- x - 1. The output, as given by the fee E sin 
gives the quotient q(x) — x? +x’. The reader may wish to check the answers. 
either the long division method or the Euclidean division algorithm. 


ined 
In the polynomial-division register the remainder at each shift a - pre i 
from the previous remainder. If r(x) is the remainder after the ith S ; : "ide of th 
next shift the contents of the stages move 1 place towards the sr aire ‘vide 
register, which is equivalent to multiplying r(x) by x, and the feedbac 
by g(x). The remainder after the (i+ 1)th shift is therefore = 
rit (x) = Rex) [xri(x)} 


' | js added 
where it is assumed that the input to the register is 0. If the input 1S l, n: v d 
to the remainder. The degree of r(x) is always less than or s divisor g(x): 
therefore the degree of xr(x) cannot exceed the degree r of de ud x), the 
Whenever xr(x) results in an x” term, so that it has the same - at we reusit? 
feedback circuit has the effect of adding (or subtracting, remember term, this att 
modulo-2 addition) g(x) to xr(x) and therefore removing the * lying r(x) " 
sponds to division by g(x). Equation 4.5 can be evaluated by reste ig 1, th 
and then adding g(x) if xr{x) contains an x” term. If the register 


this is added to the remainder. 
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The polynomial-diviston -— umbo, wre requires r shifts before the 

vidend reaches the high-order side of the register, W uch represents idle or wasted 
ai .as no division takes place durin g these shifts. This can be avoided by feeding the 
put directly into the high-order side of the register. By doing so feedback, and 
ins division, commences immediately with the input of the first nonzero bit. 
However, this does not give the remainder ofthe input p(x) divided by g(x) but rather 
ofp'(x) = x'px) divided by g(x), I his ca n be useful when carrying out encodi ng, asit 
corresponds to multiplication by x required when generating systematic code- 
words. At the decoding stage there is no requirement for multiplication by vy’ anda 
register With input to the high-order side will give the wrong error-syndrome. 
Despite this, however, it is still possible to feed the input into the high-order side 
when decoding (this is discussed further in Section 4,5), Registers with inputs to the 
high-order side and low-order side are referred to as havin g high-order input and low- 
order input respectively. 

A linear-feedback shift register with high-order input has the same feedback 
circuit as that with the input to the low-order side. It is only the input to b and the 
feedback bit by that are affected. The feedback bit now depends on the output from 
the high-order stage 5, , and the input bit bin, while the input to dg is taken solely 
Irom the feedback. Hence bp b, a + bin and bo = by compared to 4;=4,_, and 
bo=bt+ bin When the input is to the low-order side, The inputs to all the other 
Stages remain the same and bits are still shifted from the low-order side of the register 
lo the high-order side. Let's reconsider the problem considered in Example 4.2, 
namely dividing p(x) = x°+ x54 x3 4 ¥ 4] by g(x) - x^ +x + 1 but this time using 
a linear-feedback shift register with a high-order input. The linear-feedback shift 
Rasy — to achieve this is shown in Fig. 4.8. The operation of the register is 

OW described by 


bout _ be = b» T bin 


bı = hi 
b, = bo + by 
by = be 


A aod m " en 4.5 gives the results shown in Table 4.4. Note that if'eqn. 4.5 ìs 
an x? term » the re e remainder at each shif t, then each nonzero input contributes 
nonzero feedba a During the first shift Po = | enters the register giving 

ause division - f m and therefore division starts immediately. Note that 
entry into "y n with the first shift we cannot identify the information bits 
865, so only the final remainder is underlined in Table 4.4. By the 





n 
LFSR. With hi h- bd . * * es T 3 
Bh-order input, for dividing by g(x) — x^ 4- x4 1. 











(06 | Linearteedback shit registers foi encoding 


And decoding CYCNE coda 
i ^8 
lablo 4,4 
Operation of the LESR in Vig. At 


Dividing NP T p LN dn M(A) = x* 4 x H1 

Shiti Min Mm A h he rix) 
Q ü r ( ó me 

| | | | () | à 

| | ( | ! a 

\ | ( | () 0 4 

| () Q u | 0 y 

b | | Ü | | x*4j 
| () | Ü 0 x 


end ot the 7th shift the register contents are (0 | 0) piving the remainder r(x) = x and 
the output pives the quotient g(a) yo 4v 4e x* de, The remainder and quoten 
obtained are different from those obtained in Example 4.2 because r(x) and q(x) 
obtained. here are not the remainder and quotient of p(x) = x° 4 x 4 v! i 
divided by gx) evi 4: x 4: L, but rather of the polynomial p'(x) = x p(x) = x'p() 
divided by gx). We can illustrate this by using the Euclidean division algorithm to 
construct p(x) from rcv), giv), and gv): 


PN) = q(v)g(x) d r(x) 


‘ ' . $03 3 
Furthermore taking out a factor of v^ gives 


p'(x) m x! (x8 4 x? bx” x 1) 


and so 


p'(x) = p(x) 


TE ` i i =e in Fig, 4.8 are 
as required, Therefore the results obtained with the register shown in Fig 


f A Atwided by g0): 
the remainder and quotient of x" p(x) divided by g(x), and not p(x) divided by 8 


4.3 Registers for encoding 


t 
‘eters. Hel 
gisters. PP 


` ‘ ' * * ‘ ` : if’ re 
Encoding cyclic codes can be achieved in a variety of ways using shift idere 


we look at two circuits based on the polynomial-division register a secon 

previous section. The first circuit has an input to the low-order side an | 

the high-order side. Both circuits produce systematic codewords. ) polynomi 
Figure 4.9 shows an encoder for an (7, k) cyclic code with generator [ 


TN ) 
B(X) = gnk X" K Bjk Fel a, sene gx” + gi + 80 


— 
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i(x) 





Fig. 49 An encoder for an (n, k) cyclic code. 


where g,.,, = l and go = 1. The encoder consists of a polynomial-division register, as 
discussed in Section 4.2, along with an additional n — k delay stages do, dj,... 
d, 4 2, dn-k-1 and n codeword stages co, C1, ..., C42, C4. Lhe codeword stages are 
for storing the final codeword and the delay stages are for delaying the information 
bits’ entry into the codeword stages (this ensures that the remainder and the infor- 
mation bits enter the codeword stages in correct synchronization). 

Given an information word i= (iy. i, ig 5, ..., i», i}, iy) to be encoded the corre- 
sponding information polynomial is 


Kx) = hax"! 4. ip 3X? Tee ix? T 1X + d 


where i, _ is the first bit to enter the register followed by iy. 2, i, 3 and so forth. After 


— the information bits have entered the register and the remainder stages 
ntain 


r(x) = Rax [i(x)] (4.6). 


the rema; ! 

dard amen m divided by g(x). However, recall that for a systematic code- 
shifting the re in : remainder OI X i(x) divided by g(x). This is achieved by 
by n- s i ster an additional n — k times, for this has the effect of moving i(x) 
die ate lowards higher orders (which is equivalent to multiplying i(x) by 


dividing 
Contain viding by g(x). Therefore after k (1 — k) = n shifts the remainder stages 


r(x) = Rox) [x"-* i(x)] i (4.7) 

à5 regu : 
- À furthe 
“Odew = ey n = k shifts are then required to shift the remainder into the 
SO a total of k -- (n — Kk) 4- (n — k) 2 2n — k are required to 
"Two switches are also needed to disable the feedback circuit 
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and divert the bit stream when required. The final codeword polyn 
OMial js p; 
Elven h 


| g | y 
e(X) = cQax^ i u Ye j Fe ip cx? TOL. Co 
with corresponding codeword ¢ = (¢n_1, 6, 5... ., 0, c 15 Co). The en 
(7,4) cyclic code described next should help to Clarify matters. Coder for the 
Figure 4.10 shows an encoder for the (7, 4) cyclic code with generator 
g(x) =x" 4- x + 1. The register contains 3 remainder stages bo 


, by, and b i 
3 delay stages, do, di, and d needed to delay the information bits by 3s 2 along wit 


ae" | Sui hif 
the information bits occupy the correct position in the codeword Stages “nt i that 
the remainder has been computed). There is no feedback to the st rus 


Polynomial 


> ^ age b as 
not contain an x^ term and therefore 288 g(x) does 
Dot = br = b> 
b, = bi 
bi = bo + br 48) 


Seven codeword stages are needed to store the computed codeword polynomial 
which will be given by 


o(x) = egx? + csx^ + cux + CX? +X + cix +9 


with € = (c6, C5, C4, C3, C2, C1, Co) as the corresponding codeword. Table 4.5 shows the 
step-by-step operation when the information word i= (10 1 0), with corresponding 
polynomial i(x) — x° + x, is encoded. Recall that for the (7,4) code we need the 
remainder of x^ i(x) to construct systematic codewords. The operation of the register 
is best considered in three stages. Note that in Table 4.5 the information bits are 


underlined and the remainder (obtained after the 7th shift) is furthermore embol- 
ded. 


|. Shifts 1 to 4: During the first 4 shifts the information bits enter the register pr] 
the high-order bits entering first, so the first bit in is i3 = 1 followed by i2 =0, =}; 


b, Switch 1 


b 
a-dai 


S, Switch 2 
\ 


Cima El a AI——4 
sHiHekeHeHeHe 


Fig. 4.10 An encoder for the (7, 4) cyclic code with g(x) 2 x54 x4 l. 


—— — i 








| 
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Table 4.5 
Operation of the encoder in Fig. 4.10 


"mur 
Input ip)m x 7 


) bi ho bı hs by do d, d» Co Cy C2 C3 C4 Cs C6 r(x) 
- - 000 0 000 0000009 9 
| 1 0 0 oO 1 0 0 90 00000 4 
' o 010 0 010 0000000 x 
* >. 101 a l9] 0000000 x44 
^ 9 FOD 1! 010 1000000 | 
| 0 010 0 001] 0100000 y 
> —- 001 0 000 1010000 9 
° 5 110 L 000 0101000 x+] 
s- OTT — 000 0810D100 vx 
9 — 001 — 000 1001010 x 
( 997 =~ OCO 11001201 0 


| 


and ij = 0. The information bits are simultaneously fed into the delay stages. During 
this time switch 1 is closed to allow feedback, and switch 2 is in position A to allow 
theinformation bits that leave the delay stages to gointo the codeword stages. By the 
end of the 4th shift, the remainder stages contain (1 0 0) and the remainder is 
therefore r(x) = 1. However, this is the remainder of I(x) divided by g(x) and not 
v'i(x) divided by g(x) as required to construct a systematic codeword. 


2. Shifts 5, 6 and 7: Each additional shift has the effect of multiplying i(x) by x and 
dividing by g(x). So that 
shift 5 gives Re.) [xi(x)] 


sy 
shift 6 gives Ry 4 [x?i(x)] = x? 
and shift 7 gives the required remainder 
Reo) [X i(x)] = ee i, 


The j _— 
^ ma ation bits have now left the delay stages and occupy the first 4 low-order 


bn stages, During these three shifts switches 1 and 2 remain closed and in 
on A respectively, 


3. Shi 

tas Se nd 10: Finally the remainder has to be shifted into the codeword 
lo Position p io Fo needs to be open to prevent further feedback, and switch 2 set 
lOth shift the c "a t the remainder into the codeword stages. By the end of the 
Plynomi, ° CCWord stages contain (110010 1) which gives the codeword 


OX) ye a oe] 


ute c 


-(10109 | 1). Note that a total of 10 shifts are required to 





a RR M9 RM 9 9 9 9 9 0B MB T 
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To summarize, an encoder for an (n, k) cyclic code as shown in Fig. 4 
2n — k shifts for encoding, where (49 eines 
(1) the initial k shifts are needed to enter i(x) and determine + 
(2) the next n — k to obtain r(x) = Reo [x" ^ i(x)]; 
(3) the last n — k to shift r(x) into the codeword stages. 


(x) = Ry ti x). 


’ 


Example 4.3 
Here we consider an encoder for the (7, 3) code with 


ix i generator : 
g(x) 2 x^ -- x? - x? + 1 and input i(x) 2 x? + x. poly nomial 


Figure 4.11 shows the shift register for generating Systematic codew 


. : ords, 
parity-check bits are needed and so there are 4 remainder stages and Four 


Supe i; 4 delay Stages 
The only zero coefficient in g(x) is gi, therefore all the Stages except b, have feedback 
added to their input. Hence | : 

bout - br = b3 

by = b2 + br 

b, = b + br 

bi = bo 
bo = bin + br. 


Table 4.6 shows the step-by-step operation when i — (1 1 0) is encoded. Note here 
that asin Table 4.5, the inf ormation bits are shown underlined to show their progress 
through the stages, and the remainder (obtained after the 7th shift) is also embolded. 

The input to the register is i(x) 2 x^ -- x. After the 3rd shift the information 
bits have entered the register and the remainder stages contain the remainder 
Rec [(x)] = x^ + x. Four more shifts are then needed to give the required remainder 
Rg [x^ i(x)] 2 3? + 1. 

At this point the Stages co, c, and c; contain the information bits and 4 final shifts 
are needed to move these towards hi gher orders and to move the remainder into the 





Fig. 4.11 An encoder for the (7, 3) cyclic code with g(x) 2 x* 4- x? -- x^ 4 1. 
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Table 4.6 
Operation of the encoder in Fig. 4.11 


— — mm cm mte mm etm em mh tm nm — 
m t ge i oet perta pm m UID 
sse 
— 





miter RJ ta omm p mem rtt t Pm at 
— me Aea e 
— o 

m a Üns 


b, bi do di d, dh C) Ci C3 C4 C4 Cs (t, r(x) 
0 0 0000 00000001] OQ 


0 0 1000 0000000 | 

0 0 1 100 0000000 x4] 
0 O 0119 002002023720 Zi 
| 0 601 1 000000 9 x! 4 x? 
() | 0 0 0 1 100000 0 v te 
| () 00 0 0 100000 x 
1 1 0000 01 10000 PI 
D = 0000 101] 1000 x 
0 - 0000 0101 100 æ 

1 0000 00101] 10 æ 

0 - 0000 1007014 0 


codeword stages. The final codeword polynomial is c(x) = xf + x^-- x? 4+ 1 which 
pivese- (110100 1). A total of 11 shifts have been required. B 


When encoding using the shift register shown in Fig. 4.9 the first n — k shifts are 
needed to move the information bits towards the high-order side of the register. 
During this time the output from the high-order stage 5, -x-1 is zero and therefore 
the feedback is zero. This can be clearly seen in the operation of the encoder for the 
(7,4) code, the first 3 rows of Table 4.5 show the incoming bits progressing towards 
by and there is no feedback (by — 0). The first 4 rows of Table 4.6, which show the 
operation of the encoder for the (7, 3) code, show the same trend. Feedback, and 
A polynomial division, commences when the first nonzero information bit 

aves the high-order Stage, the earliest point at which this can occur is at the 
he l)th shift. 

5 completes our look at 
the register and 
| ith such an a 
put and there 


encoding when the input is to the low-order side of 
we next consider encoding using registers with high-order input. 
Pproach feedback commences Immediately with the first nonzero 
side of 4 — n shifts are required than when the input is to the low-order 
Ks ga sq ; i e will consider the (7,4) code with generator polynomial 
sidered, f nd the information polynomial i(x) =x + x as previously con- 


the high-order sign oo an encoder for the (7,4) code where the input is to 
are no delay nns a register, Comparing this with Fig. 4.10 we see that there 
AV entered the c i Ig. 4.12. This is because by the time all the information bits 

COdewor iiigos ns word stages, the remainder is ready for shifting into the 
Mages are nec Es erefore there are no synchronization problems and so no delay 
"IC Using lie sarn The feedback links in the register are the same as before, for we 
4$ moy me generator polynomial. However the adder which b;, feeds into 

h-order side of the register, resulting in the feed- 


back changin, io i the hig 
to b, — 
5 to bp by + bin and bo = by as the input to the low-order side of the 
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Switch 1 
b, 


Fu | | b 
bo [— Aeh, b ee ip) 


me IA 


^ 
^ 
— r4 rr Switch 2 


Fig. 4.12 An encoder with high-order input for the (7,4) code with g(x)=P 454 7 





Table 4.7 
Operation of the encoder in Fig. 4.12 








o —À M [à a Ra, du to 


High-order input i(x) = x x 





Shift Din by b, b. b, Co CI C2 C3 C4 C5 Cg r(x) 
0 0 0 0 0.000000 9 
| | | 1 0 | 1.00000. x41 
2 0 0 | 0 0 1 0 0 0 0 0 Xx 
3 | 0 0 1 0 1010000 x 
4 0 1 1 0 | 0.1 01000 xl 
5 0 1 1 — 0 0 10100 st 
6 — 001 — 198019190 * 
7 — 0 0 0 ~~ 1 10 B i El * 
MN i L y ER 2 23 «4 


register. Hence, for the encoder in Fig. 4.12 we get 


bp = bz + Din 

by = bı (4.9) 
b, = bo + br 

bo = by. 


Table 4.7 gives the resulting step-by-step operation of the encoder when 1i 
input is i(x)=x° +x. Note that because feedback and polynomial — > 
immediately with the first nonzero input, the input cannot be seen 1n the pw ‘et 
stages. The first bit to enter is bj, =i; = 1, the feedback bit is br= | and ! that 
polynomial division has commenced immediately at the first shift. Note 4! 3 
because the register has an high-order input each nonzero input COP’ > jts paye 
term to the remainder, By the end of the 4th shift all the information thermo 
entered the register and occupy the 4 codeword stages Co, C1, C2 and ex ring thes 
the remainder stages contain the remainder Rexx i(x)] as required.. | ion 
first 4 shifts switch 1 is kept closed, to enable feedback, and switc 2ism : * 
so that the information bits can enter the codeword stages. After the aths 
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ins is to disable the feedback by opening switch 1, set switch 2 to position B and 
shift the register 3 times So moving the contents of CO» C1, C2, C3 into c, ca, Cs, cs and 
bo, ii, P2 into Co» C1» €2- The resulting codeword polynomial is c(x) = x6 + x44. x jl 
as previously obtained. A total of 7 shifts have been used, instead of the 10 needed 
when the input is to the low-order side of the register. An encoder for an (n, k) code 
with high-order input requires n shifts, compared to the 2n — k shifts required by 
n encoder with input to the low-order side, and therefore encoding takes less time. 

Feeding the input Kx) into the high-order side of a register, with r Stages, is 
equivalent to multiplying (x) by x’. Hence for an encoder with n~k remainder 
stages the effect of entering i(x) at the high-order side is to multiply i(x) by x”~*, 
which is quite convenient because this is required for generating systematic 
codewords. However, when decoding a cyclic code there is no requirement for 
multiplication by x"^* and so entering the input at the high-order side can be a 
disadvantage, this is considered further in Section 4.5. 


rema 


d 


Example 4.4 
Consider an encoder with input to the high-order side, for the (7, 3) code with 
generator polynomial g(x) = x* + x? 4- x? 4- 1 and (x) ex^ +a. 


Figure 4.13 shows a register for generating systematic codewords. The (7, 3) code 
has 4 parity-check bits and therefore 4 remainder stages are required. The generator 
polynomial has g; = 0 and so there is no feedback to b,. Delay stages are not required 
as the information bits are fed to the high-order side of the register. The input 
i(x) = x? + x is the same as that considered in Example 4.3. The results are shown in 
Table 4.8. During the first 3 shifts the information bits enter the codeword Stages co, 
cı, c; and are divided by g(x) to give the required remainder. Note that each nonzero 
input contributes an x^ term to the remainder. The next 4 shifts are needed to move 
the remainder into the codeword stages. By the end of the 7th shift the stages co, cy, 
C2, C3, C4, Cs, cg contain (1 0 0 1 0 1 1) and so the required codeword polynomial is 
c(x) 2 x -- x -- x2 - 1. Switches 1 and 2 need to be respectively closed and in 
position A during the initial 3 shifts, and open and in position B for the final 4 shifts. 
A total of 7 shifts have been used, compared to 11 had the input been fed into the 
low-order side of the register (see Example 4.3). [] 


Switch 1 


i(x) 





~N Switch 2 


SHSHsHsHsSHSHs* 


Fig. 4, 
& 4.13 An encoder with high-order input for the (7, 3) code with g(x) =x*+2x°+x7+ 1. 


ih 
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Table 4.8 
Operation of the encoder in Fig. 4.13 


high-order input i(x) = x +g — 
SE dm A UD Ur Pin iy Ey MO) A C0 CI C2 C3 C4 Cs k r(x) 

0 0000 0 0000009 7 
b.ocH 1 0 1 1 | 1002020200 y, 
2 ł 0 1 0 1 0 110000 9 Wt 
4 = 01809 = 1911000 =, 

5 — 0010 — 90191100 qJ 
6 — 0001 — 9910110 ^ 
P. — .g 9 $9.0 — PERL tigi ð 


4.4 Registers for error detection and correction 


Decoders for cyclic codes require the same polynomial-division register as used for 
encoding, along with extra circuitry to carry out error detection and correction, 
Here we consider a decoder for error correction, based on a syndrome table, anda 
decoder for error detection. Both types of decoders can be implemented with the 
input to the low-order or high-order side of the polynomial-division register, | 
Figure 4.14 shows a decoder, for an (n, k) cyclic code, that employs a polynomial- 
division register along with a syndrome table. The remainder computed by the 
register is the syndrome polynomial s(x) of the polynomial v(x) to be decoded. The 
syndrome table needs to store every correctable error pattern along with 
the corresponding error syndromes. The decoder needs m —K stages bo Pr... ^ 
b, 2, b, 1 to compute the error syndrome, n delay stages do, d, . ++ d 2 Uy 10 
store v(x) while the syndrome is being computed, n stages eo, e1, «+++ n-2 Ene! lo 
store the error pattern given by the syndrome table and n codeword stages ^h 
Ct... Cn 2; C41 for the computed codeword. After v(x) has entered the meaa 
the remainder stages will contain s(x) and the delay stages contain v(x). The yen 
syndrome s(x) forms the input to the syndrome table and the output t$ fed in 


e A " ' (41 4€ ui 
Co, €1, ...,€4 2, €, 1. Error correction is carried out by shifting i m 
e, 1 and do, di, ...,d, 2, d, | through a modulo-2 adder. If en-1 =] rn 
leaving d„—ı is inverted as it enters co, otherwise the bit leaving dj !5 unahviv ep 


the number of errors in v(x) is less than or equal to the error-correction limit » 
the code then éo, €),...,@,—2, 6, ., Will contain the correct error pattern an ra 
erroneous bits in v(x) will be inverted and therefore corrected as they leave 
delay stages and enter the codeword stages. 

Consider the decoder for the (7,4) code shown in Fig. 4.15. The synd ‘ven in 
in Fig. 4.15 will need to contain the error patterns and error syndromes P! input 
Table 3.3. The operation of the decoder is given in Table 4.9 for a incut 
v(x) = x9 -- x^ -- x? +x + 1 arising from the codeword c(x) = xf + x PET (again 
ring the error e(x) = x°. The coefficients of v(x) form the decoder input Pi ity the 
with the high-order bits first) and 7 shifts are needed to input v(x) (for clar 


rome table 


— 





| 
| 
| 
| 
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Syndrome table 


Ms Jef cs fe] a JY YY a 


Fig. 4.15 An error-correction decoder for the (7,4) code with g(x) 2 x! txt. 


Table 4.9 
Operation of the decoder in Fig. 4.15 





Input v(x) — x9 -- x* 4- 3? tad 


Shift bin bo bi b; br eo Cy C2 €3 04 €5 €g do d, dz d, d4 d; de Co Cı C2 C3 C4 Cs C6 





00000 0000000 0000000 000000? 
111000 0000000 1000000 000009 
200100 0000000 0100000 0000007 
311010 0000000 1010000 0000077 
4 10001 0000000 1101000 00000977 
5 00000 0000000 0110100 0000097 
611000 0000000 1011010 00000577 
7 11100 0001000 1101101 genes | 
fae DEDOISO-DILOTIIB Lee es 
J ————— Q0DDDTIO n0li101L 249°) G0 
10 ————— 0000001 oootioi 10195, 
i ————— 0000000 0000119 01027 0 
jb m g&o0unbG ODOT) 00125,0 
QD» eese G HH seo01 100125, 
14 ————— 0000000 0000000 1129-77 


| 1 10) 
erroneous bit is embolded). By the 7th shift the remainder stages contain ( that 
which corresponds to the error syndrome s(x) = x + 1. From Table 3. ee s the 
s(x) 2 x + 1 gives the error position x? and error pattern (000 1000), this e delay 
input to the stages eo, €e1,....eg. Furthermore v(x) now fully occupies 


— 


——————— eee ARA PRAE SCREAM d 


es as ———_ — —— M M M ———— — —— 9 
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v(x) 





Detector 





Fig. 4.16 An error-detection decoder for the (7,3) code with g(x) 2 x! - x^ txl. 


stages, At each subsequent shift the output of the stages eg and de are added together 
and fed into the codeword stages. By the 10th shift the erroneous bit and error 
position have reached the stages ds and es respectively, and at the 11th shift the 
erroneous bit is corrected as it leaves dg and enters co. Shifts 12, 13, and 14 are 
required to move the remaining bits into the codeword stages. The final state of the 
codeword stages is (1 1 00 1 0 1) which gives c(x) = x8 4- x^ 4- x 4- 1 as required. 

A decoder for error detection does not require a syndrome table but just a poly- 
nomial-division register, to determine the error syndrome s(x), and a detector to 
indicate whether or not s(x) is zero. If the detector indicates that s(x) is nonzero then 
the input v(x) contains errors, otherwise v(x) is a codeword. Consider for example 
nd 3) code, with generator polynomial g(x) 9 x* x^ Ex l, used for error 
tibia. Figure 4. 16 shows a decoder consisting of a polynomial-division register 
stig : Stages feedin gintoa detector. Here the detector is an OR gate with 4 inputs 
x) a output is ] if any of the inputs are 1. If bo, bi, b>, or b3 are nonzero, after 
an: n the register, the detector output will be 1, indicating that s(x) IS 

Tw : that v(x) therefore contains errors. The detector output is 0 only if do, 
2 and 53 are 0, that is when v(x) is a codeword polynomial. 


T ; 
he Meggitt deco der 


M . 
Polynomial Ary any one error syndrome. Consider a cyclic code with generator 
"ift of e(x) > x) and let e(x) be a correctable error pattern and e'(x) a 1 bit cyclic 
wards high orders. If s(x) and s'(x) are the error syndromes of e(x) and 
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Ax) respectively then síx)— Rz etx) and s(x) = Reel xs(x)]. Furtherm 
eix) is a cyclic shift of e (x), again by i bit towards high orders, then its a Ore, if 
given by s (x) = Reefs (x). Con tinuing this we can see that theerror s eh, 
All cyclic shifts of e(x) can be obtained from s(x). With regards to the ae Mes of 
division register s ( x)is obtained from s( x) by shifting the register once. If tpe ial. 
contains s(x). then a single shift has the effect of multiplying s(x) by x and div » 
(x). therefore giving s(x). A second shift will produce s" (x) and so forth ing by 
- In place of a syndrome table the Meggitt decoder has a detection circuit - 
input is the error syndrome s(x) and whose output is 0 or 1 (see Fig. 4.17) Ose 
etection circuit is arranged to detect a single syndrome s4(x) usually taken to bes 
syndrome corresponding to an error in the high-order bit of v(x), so that j 


f : f 1—Í3 
Så [ Xj = Rete) ix” f- 


During the operation of the Meggitt decoder the first n shifts are required for 
entering »( x) into the register and into the stages do, di, . .., d, .,. By the end of the 
nth shift the stages bs, bis- - -+ Du i1 contain the syndrome s(x) = Recjv(x)] and 


ds. d;...., d__, contain v(x). If s(x) = sa(x) the output of the detector, denoted by s, 
so that the input to the stage cy is d,_; + Sa- If the stage d, ,containsan erroneous bit 
then s(x} = s4(x), 54 = 1 and the bit will be corrected as it leaves d, to enter cs. At 
the next shift the error syndrome will be s(x) = Rzcj[xs(x)] and the process repeats 
itself. If (x)= s4(x), then sa = 1 and the bit leaving d,.., is inverted as it enters cp, 
otherwise the bit is unaltered. This continues until v(x) has left do, di, ... , d, . and 
occupies the stages Co, €1, ..., €,—,. A total of 2n shifts are required for decoding, 
where the first n shifts are for determining the error syndrome of v(x) and the 
remaining n are for error correction. 

Figure 4.1% shows a Meggitt decoder for the (7, 4) code with generator polynomial 
g( x) — x^ ^ x — 1. Consider again the codeword c(x) = xÉ + x^ + x + 1 incurring the 





uv | we 
ted s poo s pene Orbe 


yt xj | 
| Syndrome detector 


Ch} C-2 i C-3 Tv [6 [5 


Fig. 4.17 A Meggitt decoder for an (n, k) cyclic code. 
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v(xi 
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Fig. 4.18 A Meggitt decoder for the (7, 4) cyclic code with g(x)2 v - xa LE 


error x^ so giving v(x) = xf + xt + x +X + Las the word to be decoded (see Section 
44 and Table 4.9). The input to the decoder is (Ve. V5, V4, V3, Pa, 
5.99) 7 (101 101 D) where v; is in error. The detector is arranged to detect the error 
syndrome of the highest-order bit. so that here we have 


Sa(x) = Rei [x*] 


and given the generator polynomial g(x) 2 x^ + x 4 1 this gives 
$g( X) — x* +L 


Hence the detector needs to detect when bọ = 1,6, — 0, and b; = |. Thisisachieved by 
feeding by, by, and b; into a 3-input AND gate with the b, input passing through an 
Refer, When by = |. b; — 0, and b» = J all3 inputs to the AND gate are ł and so the 
ates output $a — l. At all other times the gate's output is 0. 
-- — step-by-step operation is shown in Table 4.10. Fourteen shifts 
fies to "E for decoding, of which the first 7 are needed to obtain the error syn- 
underline X)and the last 7 for error correction. As before the coefficients of v(x) are 
neous bit; to show their progress through the register, and furthermore the erro- 
oh...» embolded so that its progress can be easily seen. Bits enter the register 


Igh-or 
bad der first, simultaneously feeding into the register and into the' stages 


and 5, b. ds. By the end of the 7th shift the stages do, di, .. . , dg contain vo, Vi, .. . , vg 
= 1, b2 =0 which give the error syndrome s(x) =x + 1. As s(x) ¥ sa(x) 
More chip, Put sa =O and so "s Will not be inverted as it leaves dg to enter cp. After 
| e thers “Ironeous bit V3 occupies des and bo, b, b; are 1, 0, 1 respectively, 
“ COrrect _ Syndrome S(x)=x°+]=5, (x) and sg = 1. Hence at the next shift v3 


s as i 9 ^ B * 
he 'eMainin A T. fed from ds and into cg. F inally 3 more shifts are required to move 


its Into the codeword stages. 
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120 |t Table 4.10 


6:3 r txl 
Input X +X ** T 
shit hb hon Ad enc maaana ay 

5 p00 0 — 90000098 0000000 g 
1 (gg. 6 — 10900008 0000000 , 
7 soto @ — 2195992 0000009 , 
5 11010—180192997 0000000 2, 
4 pono | — 1181992 wean s 
5 5 589-8 ii 0000000 ọ 
6 1100 0 101432190285 See eres 1 
; 11190 0 ^ 11011901 00000200 x4 
g —011 0 0 01109110 10000200 z4, 
E mtti: § 8 0011011 01900020 riz 
i —101 11 000112! 1010000 x2 
13  *50ü t: o @ooOG0TLE 0101000 1 
12 010000000011 0010100 x 
13 |» 001 1 0 0000001 1001010 xr 
14 | 110 10 0000000 1100101 x1 
—  unsconmaar de oca npud ee 

b, 





v(x) 


ie, 
X HISHISHISHRHISHISTPS 


Fig. 4.19 A Meggitt decoder for the (7, 3) cyclic code with g(x) -x*4 x Bx 


Example 4.5 ode 
Figure 4.19 shows a Meggitt decoder for the single-error correcting (7,3) à d 
with g(x)— x* -- x - x - 1. Determine the step-by-step operation when «3^ 
x$ E x5 4- x^ + x incurs the errors (a) e(x) =1 and (b) e(x) 7 x - 


l , "T and 
The detector needs to determine when the high-order bit of the input 1s 1” -€— É. 
so it needs to detect when the remainder stages contain the error syndrome * 


— 
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trig gives 
This 8 sa(x) = Reli] = x +x + d 


yr syndrome that needs to be detected. Hence the detector needs to detect 

as the erre = [yd =O, and 6;= l, which can be achieved by feeding bo, by, b», 

when x Bin 4 4-input AND gate with 4) passing via an inverter (as shown in 
into : 

and b3 


Pip s o(x) = ex +x +x incurs the error e(x)=1 then v(x) = x 4 x54 
(a) ner | and the decoder input is (1 1 1 00 1 1) as shown in Table 4.1 1 (a). 
Table 4.11 
Operation of the Meggitt decoder in Fig. 4.19 


(a) Input v(x) —Y +x 
by by by b3 be sa do di da dy da ds de co ci e» 03 cq csee (X) 


Shift bin ind 

0 0000 0 — 0000000 0000000 0 
mr 11000 0 — 1000000 0000000 1 
) 1 1700 0 — 1100000 0000000 x+] 
jy 1 11100 — 1110000 0000000 4x4] 
4 0 01117 0 — 0111000 0000000 Sj) 
5.0 1101 1 0011100 0000000 xx 
6 1 0000 1 —1001110 0000000 0 
7 1 1000 00 1100111 0000000 1 
8 — 0100 00 0110011 1000000 «x 
9 = 0010 0 0 0011001 1100000 f£ 
0 — 0001 00 0001100 1110000 JV 
1 — 1710 10 0000110 0111000 4x41 
^ —0111000000011 0011100 x4 x4 4 
P -= LIDI 1-A- 8800007 1007110 SAri 
4 — 1000 10 0000000 01007111] 1 





(b) Input v(x) = x5 + x4 +X 


Shift b, bo b, b» b, b, Sq do di d» di da ds de Co Ci C2 C3 C4 Cs C6 s(x) 
B EE oc a tae don i RR 
0 | 00 0 









0000.0. 0000000 00000 
, 900000 0 — 0000000 0000000 0 
; 110000 —1000000 0000000 1 
+ o 24190 0— 1100000 0000000 x«l 
s 9 21100—0110000 0000000 CHK 
s pel? 0 — PGT Tess 0000000 x 
|^ o 111! 1 —10801100 0000000 zz) 
8 ssl 11 0100110 0000000 x 4x41 
9 1900 10 0010011 1000000 1 
w 210000 00071001 1100000 x 
" 59,0010 00 0000100 1110000 x 
2314,21 90 0000010 0111000 x 
3 9,110 10 0000001 0011100 xx 
M 411100 0000000 I001T10 xx 
:9! 10 0000000 0100111 xax 
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coding cy 
Uhe remainder at the "th shift is sO) — 1 which is tl 


| hif b | 1e CFTOF Syndras 
the Lh stutt the erroneous bit occupies the last stage of t] ln 
remaimder stages contam the syndrome sax) and s . We del 


n r . Nd — | " Hei 
the erroneous bit is corrected as it leaves d; and enters c EM 


(b) Here vd =a bv dv the error is detected at the 7th shift and cors 
Sth as shown in Table 4.11 (0). "Of Teeted ai the 


n | 
We have seen that feeding the input to the high-order side Of à polvnos: 
division register, for an Qu A) eode, is equivalent to multiplying the bou tt 
his is useful when encoding, tor multiplication by v” $ is required fot wa | 
systematic codewords, At the decoding stage there is no such requirement nn 
v9 has entered the register the resulting remainder is r(x) = Realy" (ayy whichis 
not the error svadrome required, However r(x) still contains information that : 
solely dependent on errors within vO), Given a correctable error pattern ex) there 


is à umque Correspondence between the error pattern and the remainder F(x), and 
theretore | 


«the 
! shi 


(X), ly 
the 140 


s(x) = Real ola) (4.10) 


is an error syndrome of viv). The ditlerence between s(x) and the ‘normal’ error 
syndrome sQO = Rayo] is the correspondence between error syndromes and 
correctable error patterns, Consider for example the (7, 4) code with KOENE 
X 1. The error syndrome sQv) of, say, e(x) vh is wae, but using eqn 4.10 gives 
y (XY 1. Table 4.12 gives the error syndromes s(x) and s'(x) for the (7, 4) code forall 
the correctable error patterns, From Table 4,12 we can see that the error syndromes 
S (X) are the same as s(x) and differ only in their correspondence with the error 
patterns e(v). Therefore there is no reason why o). instead of s(v), cannot be used 
as the definition of the error syndrome of (yw). l | 
Consider now a Meggitt decoder for the (7, 4) code with input to the high-order 
side (see Fig. 4.20), Recall that the detector needs to detect an error in the high-order 
position x°, and from Table 4,12 we can see that this means that we need to — 
when the error syndrome s'(X) = X^, that is when bo = 0, ^, = 0, and ò m LA - 
AND gate can be used for the detector with inverters on the 5o and by inputs lo er 
gate. Decoding proceeds in the same way as that already described for a Megs 


Table 4.12 | 
Error syndromes for the (7, 4) code with g(x) - N * Nt | 





Note: s(x) = Reo] and s'(Q) = Realy (9l 


e(x) s(x) v(x) 
e — eI ATID i 
| xi | 
x \ vee 
2 M Xx l 
x x 1 ee | 
x" x? +x | | 
» x3 x4 1 x . | 
x? 1 X | 
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V(x) 





Fig. 4.20 A Meggitt decoder with high-order input for the (7.4) code with g(x)= x° + 


“+l. 


Table 4.13 
Operation of the Meggitt decoder in Fig. 4.20 


High-order input vx) = x"  x* x! x 1 


m 
c^ 
~ 
c 
E 
e 
~ 
— 


Shift bn bo b, ba be sa do di do dà da ds de Co Ci C2 €3 C4 C 


eee Aaaa 


0 000 0 ~ 0000000 0000000 0 
I1 4310 1 1000000 0000000 x+1 
20 011 0 0100000 0000000 xx 
| 1 001 0 1010000 0000000 xv 
41 000 0 1101000 0000000 0 
|^ 0 000 0 0110100 0000000 0 
6 1 110 | 1011010 0000000 x«l 
^1 101 1!) 0 1101101 0000000 x+1 
100 1. 0 0110110 1000000 1 
i 01000 0011011 0100000 x 
^ 001 0 1 0001101 1010000 x 
s !0 100000110 0101000 x+ 
" /! 1 00 0000011 0010100 wxetx 
4 ||! 10 0000001 1001010 xxl 
—— 01 10 09000000 1100101 x4 

MM MÀ HU ra — 


decode 
r | 
With input to the low-order side. Table 4.13 shows the operation of the 


decoder | | 

nomia] bp n nput v(x) = x + x44 x? + x + 1 (arising from the codeword poly- 

required t Ha + X" -- x 4-1 with the error e(x) = x^). Note that 7 shifts are still 
?Plain the remainder and 7 to correct the error. 


b 
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S 


A Meggitt decoder for a single-error-correcting code c 

dromes ot all the single-error patterns from just one error s 
error-correcting code, the decoder needs to determine the error synd 
single- and double-error patterns. To achieve this requires a r An of all 
error syndromes of double-error patterns from which all other error s n of 
be obtained by cyclic shifts. The error syndrome of a single-error mim 
single-error pattern is also needed to deal with single errors. Consider int E 
double-error-correcting code with g(x) =x" +x’ 4+ x84 xt 4 l, this needs hs (15,7) 
15 single errors and 105 double errors. A decoder based on a syndrome ure 
would need to store 120 error patterns along with their error syndromes, With 
Meggitt decoder, however, we need only to consider the 15 error patterns shown " 
Table 4.14. All other correctable error patterns and corresponding error syndromes 
can be derived from these 15 error patterns. For example, taking cyclic shifts of 
the error pattern given in the second row of Table 4.14 gives the error patterns 


Omputes the 
yndrome. Fo 


ra double. 


(000000000000110) 
(000000000001100) 
(000000000011000) 


(011000000000000) 
(110000000000000) 
(100000000000001) 


which are all the different patterns with two successive bits in error. Each error 
pattern in Table 4.14 requires its own detection circuit and all error patterns E 
checked as decoding progresses. The decoder still operates in the manner describe 


Table 4.14 — 
Syndrome table of a Meggitt decoder for the (15, 7) double-error-correcting € 
Syndrome table of a Meggitt decoder for the (15, 7) double-error-correcting COU" 
e S 
B a e a a r$ Ra ia 
000000000000001) (00000007 
(00000000000001 1) (000009. 
(000000000000101) (QOOUD o, 
(000000000001001) (00007761 
000000000010001) (00010974 
(000000000100001) (00100 ron 
(000000001000001) (01007 4) 
(000000010000001) 10009 6 
(000000100000001) d 1015 19 
(000001000000001) DT 0o 
(000010000000001) q 1511100 
(000100000000001) ODO. at 
(001000000000001) QI orum 
(010000000000001) (01 501001 
100000000000001) OD ee 


Eee 
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= jingle-crror-correcting code and the same number of shifts 2n are required 
for a SINE can be simplified by taking into account error patterns that can be 


1 ble 4.14 ` N a b " " * " 
ined from cyclic shifts of other patterns. An example of this is the first double 
QUM 


error 
(00000000000001 1) 
hen shifted by one bit towards the right gives 


(100000000000001) 


which W 


ihe last entry in the table, Hence either, but not both, of these patterns can be omi tted 
from the table, The 14 double-error patterns can be arranged into 7 pairs, where 
within each pair the 2 error patterns differ only by a cyclic shift. By taking this into 
account the Meggitt decoder needs only to detect 8 error syndromes, namely the 
single-error syndrome and one syndrome for each of the 7 pairs of double-error 
patterns, The resulting Meggitt decoder requires a simpler detector but an addi- 
tional n shifts are needed to ensure that error patterns that have been excluded from 


the table are decoded. 


Problems 


4.1 Figure 4.21 shows a linear-feedback shift register with 8 stages. Given that the 
register is initialized. with (bo, bi, b2, b3, ba, bs, bg, 57) 2(0 0 1 1 0 1 0 1) 
determine the state of the register after: 

(a) 5 shifts to the left: 

(b) à further 4 shifts to the left; 

(c) 18 shifts to the right, from the initial state not from the state after (a) 
or (b), 

42 Figure 4^2 & > 
LE 4.22 shows a linear-feedback shift register with high-order input. 

" A ermine the contents of the register for the input (1 1 0 0 1 0). 

* ^ linear-feedback shift register has 


bp = by 
by = by + br 
by = bj 
b, = bo + br 


by = bin + br. 








MEER 
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coding cyclic Codes 





Fig. 4.22 An LFSR with a high-order input. 


a =O a Ha ee lea 


Fig. 4.23 An LFSR for dividing by x+ x^ + 1. 


Determine the register and the final state of the register given the input (0 | 0 
1 1 1). 


4.4 Figure 4.23 shows a linear-feedback shift register for dividing by the 
polynomial p(x) = x* 4- x? +4 1. By considering the operation of the register, 
determine the remainder and quotient of x?-- x*-- x?4- 1. divided by p(x). 
Check your answer using the Euclidean division-algorithm. 

4.5 Determine a linear-feedback shift register for dividing by the polynomial 
p(X) — X? +x 4x41. By considering the operation of the register, determine 
the remainder and quotient of x’ + x? + 1 divided by p(x). Check your answer 
using the ‘long hand’ method for polynomial division. 

4.6 Figure 4.24 shows a systematic encoder for the (15,7) cyclic code with 
generator polynomial g(x) =x° + x44 x7+x+1. The input is to the low- 
order side of the encoder. Given that the encoder input is the information 
polynomial i(x) — X^ 4- x? +1 determine the resulting codeword polynomial 
&x). showing the changes to the stages as encoding progresses. | 

4.7 Construct a systematic encoder, with low-order input, for the (15, 11) cyclic 
code with generator polynomial g(x) — x*4- x 4- 1. Given the encoder input 
(x) x" yaa i determine the resulting codeword polynomial—showing 
the changes to the stages as encoding progresses. 

4.8 Repeat Problem 4.7 using an encoder with an high-order input. Show that i 
encoder with the input to the high-order side requires less shifts to enco 
than the encoder with the input to the low-order side. 


; ing 
4.9 Construct a table of the correctable error patterns e(x) with correspon e- 
error syndromes s(x) = Ry. fe(x)] and s'(x) = Raol” 7 "e()] for the $ 

error correcting (15, 11) cyclic code with g(x) 2 x* -- x-- 1. 


PPAR UAR tt dp pct 
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4.10 Construct a Meggitt decoder, with input to the low. -ord 
(15, | 1) code given in Problem 4.7. If the decoder input K er side, 


X 
x * corresponds to a codeword polynomial c(x) that has ora 
error, determine c(x). Tred a sing 


Jor the 
ti 


4.11 Repeat Problem 4.10 using a Meggitt decoder with in 
side. put to the high-orde, 





algebra 


: 


Linea 
P 


is chapter we consider elementary aspects of linear algbra that are required 

[n this ilv for an understanding of linear codes in terms of vector spaces, and BCH 

Se S dered in Chapter 7. Once we establish the concepts of vector spaces we 

€ linear codes. The introductory notes on fields given in this chapter are 

tended considerably in Chapter 6, which considers the mathematics for BCH 
codes namely that of Galois fields. 


5,1 Sets 


The mathematical notion of a set differs little from our ordinary idea of a set as a 
collection of objects'. Objects either belong to the set or do not belong to the set, 
there is no in between state. A set with n objects is written as 


[315-85 «« gii] 


where the objects 5), 55,... ; 5, are referred to as the set's elements. This is known 
as a finite set as the set contains a finite number of elements. Examples of finite 


— : and the set of al] integers (0, +1, £2, .. J. Not all infinite sets can be 
n terms of the first few elements of the set, for example the set of all real 

ài maa ly n be expressed in terms of a few of its elements. 
amiliar with he "e between sets can be defined and the reader may be 
d the set d ^ the union and the Intersection Of sets, so giving the set of all 
between Sets that >*t common elements respectively. However, it is not operations 
We are interested in, but rather operations between elements within 


d set and » ' 
3 In doi L’ , el 
ng SO we create higher' mathematical structures known as groups. 


2 Groups 


èroup js 
Within y ` CONstru 
thin the l cted from a set by defining a group operation * between elements 


C t ° "6 s 
at the following conditions are satisfied: 
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|. The group is elosed under the operation x in that for any two el 
within the set then the element ements a ang; 


cmarkb 
also belongs to the set. The group is said to have the property of 
em ® M ; ; à " s 
Ihe operation * is associative, so that given the elements a, b and 
) 5 


x (b “+: c) m (a * b) * C. 


losure 
C then 


(5.1) 


In other words the order in which the group operation IS carried 
Out j 


immaterial, S 
V There exists a unique identity eleme 


nt I] within the set such that for an 
element a i 


axl=[xaąaz=aąa. 


(52 
+, For each element a there exists a unique inverse a’ within the set such that 
axd —-axaz-l. (5.3 
Furthermore, tf 
axb-bxa ($4) 


lor all elements a and A, then the group is said to be a commutative group. Conditions 
| to d are necessary and sufficient for a set and operation to form a group. Note that 
4 group need not necessarily be commutative. Note also that commutative groups 
are also called Abelian groups (after the Norwegian mathematician Abel). The 
group operation is normally addition or multiplication so giving additive groups or 
multiplicative groups respectively. 

Consider the set of binary numbers {0,1} along with modulo-2 addition. The 
closure property is obeyed because modulo-2 addition always gives 0 or | (se 
Table 1.4). Addition is clearly associative, for example 0+ (1 + 1)=0+0=0 and 
(0 + D) + Lo 1+ 1=0. The identity element is 0, and each element is its own inverse 
as O-+0=0 and |+1=0. Furthermore the order in which elements are added À 
irrelevant, for example 0 + 1 = 1 +0, and therefore modulo-2 addition over the * 
(0, 1] forms a commutative group. Whilst this may appear to be a rather triv! 
example, this is nevertheless an important group. 


Example 5.1 0.1.2.4 
Consider whether ordinary addition forms a group over the sets (a) (0, ^; 
and (b) {0,+1,+2,...}. 


ther 
"^ ^ è e . ives ano 
(a) The set is closed because the sum of any two positive integers 8 af 


positive integer. Addition is clearly associative, for example adding ~ dent 
gives 7-- (4-17) 27 4-21 228 and (74-4) - 17 11 4+ 17=28. - a 
element is 0 as adding 0 to any integer leaves the integer unaltered. - e 
nonzero elements in the set do not have an inverse element within ad 
example the inverse of 9 is —9 which does not belong to the set t5" 


r EI $t , * u = 
Therefore addition over the set {0,1,2,...} fails to generate à gro A 
- ec 
(b) As in (a) above, addition over the set (0, +1, £2, ...J satisfies "s eleme? 
associative rules, and again the identity element is 0. Hog ua permor 
now has an inverse within the set and therefore a group 1S tormes exam? 


AP al; 
the order in which two elements are added together is immater 


— . ef 
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2:135 13, and so the commutative rule is met. Hence addition over 


gr (9, 1, £2. -- .) forms a commutative group. 0 
the sel iv? A 
btract two elements within an additive group does not require the definition 
To su ad group operation. Instead subtraction is carried out by replacing the 
of a m be subtracted by its inverse element and then carrying out the group 
elemen 
operation, and 50 
a—-b-a-d(-b) 


re elements of an additive group and —d is the inverse of b. In a 


a and ba , ie 
where p replacing an element by its inverse defines the process of 


multiplicative grou 
division and so 
a-b-ax(b) 

where b'is the multiplicative inverse of 5; a + bisalso written as a/b. Subtraction and 
division can be thought of as inverse group operations defined in terms of the first 
group operation through a — b — a -- (—b) and a — b — a x (P! ) respectively. Note 
that the associative and commutative properties of a group apply to the group 
operation and not to the inverse operation. So for example in an additive group 
commutativity means 7 —4— 7 4-(— 4) 2 (—4) 4-7 2 —44-7 and not 7—4—4- 7. 
Ina multiplicative group associativity applies to multiplication and not to division, 
for example 2 + (7 + 4) # (2 + 7) + 4. 

Example 5.1 shows that addition over the set (0, +1, +2, ...} forms an additive 
group. Multiplication over the same set fails to form a group because none of the 
elements have a multiplicative inverse. Multiplication over the set of nonzero 
rational numbers (that is numbers that can be expressed as a/b where a and b are 
nonzero integers) does however form a group. Here the identity element is 1 and 
given an element c = a/b then its inverse c' = b/a. Multiplication is both associative 
and commutative, and we therefore have a commutative group. An additive group 
— constructed by including the 0 element, so that we have the set of rational 

ers, 
sey ay a subset of elements within a group forms a group under the group 
Subgroup k 3 fe a case the subset and the group operation are said to form a 
inteperign ims is group of rational numbers contains all the integers (since an 
top. Tum us num ber) and f urthermore addition over the set of integers forms 
al ration! E the additive group of integers isa subgroup of the additive group 
oes not form 4 s The set of positive integers is a subset of the set of integers but 

AS With sets subgroup of the additive group of integers. uu 
Ihite group is hai Oups can be finite or infinite, and the number of elements within a 
taking int spars - as the order of the group. A finite group can be constructed by 
after dividin 0 ulo-m, where n modulo-m is defined as the remainder obtained 

81 by m. If r is the remainder of n divided by m then we write 


Which n = r modulo-m 
can also be Written as 


i ample, 
Althmeg: : ? modulo-4 = | and 13 modulo-5 = 3. We have already met modulo-2 


IN wh; 
Which the only integers allowed are 0 and 1. Taking integers modulo-m 


i|. 








ser. 
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produces the m integers 0, 1, 2,...,m — l. Note that the remainder is alwa 
m. If n=m then YS less than 


m modulo-m = 0 


| (5.5 
and furthermore if n is a multiple of m so that n =a x m where a is an integ | 
Er, then 


(a x m) modulo-m = 0. 
(5.6) 


Given two integers a and 5 then using modulo-m addition 


(a+ b) modulo-m =r 


(5.7) 
where r is the remainder of (a + b) divided by m. For example under modulo.4 
addition 1 +5=2and 17+ 6 = 3. Under modulo-m addition each nonzero integer q 
has an additive inverse given by m — a, and 0 is its own inverse. Furthermore 
modulo-m addition is closed, associative and commutative and therefore under 
modulo-m addition the set (0, 1,2,...,/m — 1j forms a commutative group. 


Example 5.2 | 
Construct the additive group of integers modulo-5 over the set (0, 1, 2, 3, 4}. 


We need to obtain the remainders when integers are added pairwise. Adding 0 to any 
element leaves the element unaltered, the remaining sums are 


1+ 1 = 2 modulo-5 
| +2 = 3 modulo-5 
1+3=4 modulo-5 
1 +4 = 0 modulo-5 
2 +2 = 4 modulo-5 
2 +3 = 0 modulo-5 
2 4-4 — ] modulo-5 
3+3 = 1 modulo-5 
3 -- 4 = 2 modulo-5 
4 -- 4 — 3 modulo-5. 


integers because | 
o forth). | 
B. 


There is no need to consider the remaining combinations of pairs of 
addition is commutative (e.g. (3 + 2) modulo-5 = (2 + 3) modulo-5 and s 
The resulting additive group is shown in Table 5.1. 


Table 5.1 
The additive group of integers modulo-5 
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» 53 
example - 


‘tive inverse Ul e. mw ` ddar i 
re ddition the additive inverses of 1, 2, 3, and dare 4, 3, 2, and I respectively, 
4 


are o 


rse of each element in the additive group of integers modulo-5. 
nvers ° 


of a nonzero integer à is given by m — a, therefore under 
The ae 
modulo-? 
The invers 


;Micative groups can be constructed in a similar way, using modulo-m mul- 
Multip pe ich gives the remainder of the product of two integers. However, 
plicat it slication only generates groups for prime values of m and the group 
modulo [um — 1}, the O element is excluded from the set because 0 does 
aa = reatieliontives inverse, If pris not a prime number then modulo-m mul- 
ae the set (1, 2, ..., m — l} does not produce a group. Hence two groups 
sra constructed over the set (0, l. 2....,m— 1}, an additive group over all the 
elements in the set and a multiplicative group over the set's nonzero elements, 


Example 5.4 | g mE 
Construct the multiplicative group over (1, 2, 3, 4) using modulo-5 multiplication. 


Taking the product of an element with | leaves the element unaltered, the remaining 


products modulo-5 are 


2x 2 = 4 modulo-5 
2x 3= 1 modulo-S 
2x4= 3 modulo-5 
3x 3 = 4 modulo-5 
3 x 4 = 2 modulo-§ 


X 
4 x 4 = 1 modulo-5. 


Table 5.2 shows the resulting group. . 
. We have seen that the additive inverse of an element a is m — a. The multiplicative 
Inverse of 


ihe sre Tu element a is the element a' such that a x a' = 1. For example, in 

likewise the ! Seyi group the Inverse of 2 1s 3 because 2 x3izl modulo-3, 

ve inverse XR of 3 is 2. It is possible for an element to be its own multiplica- 

modulo. s n or example 4 x 4 - | modulo-5 (see Table 5.2) and therefore in the 
? multiplicative group 4 is its own multiplicative inverse. 


Table 5.2 
The modulo-5 multiplicative group 
aaia rari nat l 
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5.3 Fields 


To obtain the ordinary arithmetic that we are familiar With 


"gr Ae the idea 
to be extended to that of a field. This is achieved by defining a a à group Need 
within a commutative group, that also forms a commutative grou Ond op tion 


a 
P OVer the 
S 
ive for a field to p. 


n can be additio 


of elements. Note that both groups must be commutat 
structed. In a multiplicative group the second Operatio 


elements can be multiplied and added together. Each gr D, $0 t i 


! ! « i OUP operation satin.. < 
conditions given by eqns 5.1 to 5.4 and furthermore the two group Minis the 
satisfy the distributive rule LONS must 

ax (b+c)=axb+axc (sa 
è) 


where a, b, and c are now referred to as field elements or scalars. A field has tw 
identity elements; the additive identity and the multiplicative identity. Each M 
element has an additive inverse and a multiplicative inverse (except 0 which does not 
have a multiplicative inverse). In summary we can think of a field as: 


l. A set of elements. 


2. An additive operation which forms a commutative group over the set's elements, 
3. A multiplicative operation which forms a commutative group over the set's 
nonzero elements. 


4. [he two group operations satisfy the distributive law given by eqn 5.8. 


Within a field inverses of the field operations are easily defined (as already discussed 
for groups) and therefore subtraction and division (by nonzero elements) can be 
carried out. Hence within a field there is the mechanism for addition, subtraction, 
multiplication, and division that we encounter in ordinary mathematics. As with 
sets and group, fields can be finite or infinite, and the number of elements in a field i 
the order of the field. 

As an example of a field consider addition and multiplication over the set of real 
numbers. Both operations form commutative groups over the set of real numbers 
and the two operations satisfy the distributive rule. Therefore this gives 4 field, 
known as the real field. We have seen that addition over the set of gon 
{0,+1,+2,...} forms a group but multiplication fails to do so, and therefore the i 
of integers under addition and multiplication is not a field. This failure1s not — 
of the multiplication operation, for the product of two integers gives an integer, P 
rather because the division of an integer by another integer does not always aa 
integer. Over the set of integers addition, subtraction, and multiplication ern 
carried out but not division. This gives a mathematical structure called a ring s - 
between a group and a field. Within a ring, multiplication is possible p xa 
possible in an additive group) but division is not possible (which 15 poss! 
field). | E 

Fields can be constructed from modulo-m addition and multiplication. "- 
arithmetic forms an additive group over the set (0, 1) anda multiplica ve additio? 
the nonzero element of (0,1). It follows therefore that munt jeld. 
and multiplication over the set (0, 1) generates a field, known as the |tiplicatie 
Larger fields can be constructed by taking modulo-m addition and mu 


— . f 
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example a prime field under modulo-7 arithmetic. 
C 


ted over the set of integers (0, 1, 2, 3, 4, 5, 6}. To construct the 
sum modulo-7 and product modulo-7 of integers taken 


The field 15 construc 
Tables 5.3(a) and (b). : 


need evaluate ms 
vise Doing this BINS 
er should now realize that the result of a calculation depends on the field 
he calculation 1s performed. As an example consider (2 + 3) x 3+4 
ich is 19, 4 and 5 when the fields are the real field, the modulo-5 field 
odulo-7 field respectively. We have seen that the additive inverse of an 

and the I m — a, and that the multiplicative inverse of a nonzero element a is the 
poms 7 such hai a x à! = | modulo-m. In the prime fields subtraction and divi- 
rede be carried out by replacing an element by its inverse and respectively car- 
i out addition and multiplication. For example, in the modulo-7 field dividing 
by 41s equivalent to multiplying by 2, as 2 and 4 are multiplicative inverses of each 


other (4 x 2= 1 modulo-7). 


The read 
within which t 
the result of wh 


Example 5.6 
Evaluate ((2— 3) x 3)/4 over the prime field modulo-» when (a) nm-— 5 and 


(b) m — 7. 


(a) In the prime field modulo-5 the additive inverse of 3 is 2 and the multiplicative 
inverse of 4 is 4. Hence 


((2 — 3) x 3)/4 = (24+ 2) x 3x 4 modulo-5 
= 4x 3 x 4 modulo-5 = 3 modulo-5 = 3. 


(b) Here the additive inverse of 3 is 4 and the multiplicative inverse of 4 is 2. Hence 


((2 = 3) x 3)/4 = (2 +4) x 3 x 2 modulo-7 
= 6 x 3 x 2 modulo-7 = 1 modulo-7 = 1. C] 


Table 5.3 


Do C1 4 W RO 
Oui BR WhO — 
Om BR Uh — 
WW 9 B ho 


TM 


the real field, bearing in mind that variables and constants ean evene Way asi 
defined within the field and the arithmetic appropriate to the Held € Vals 
: H N E 





136 | Linear algebra 


. x i , ; i) 
all calculations, Consider for example the simultaneous equations to he used in 
Vb AV = 2 
4x + 6v = 3 
defined in the prime field modulo- 7. The equations ean be solved by Tirst elimina 
one of the variables, Multiplying the first equation by 6 gives ML 


Ax be Spree § | 
subtracting this from the second equation gives ór- Spo ad § 5 and there 
t , i Ta ! 0 
ye S, Substituting v= $ into the first equation gives Ju 43 2 and so ya) ow 

ede 


reader ean check that v c 2 and v c satisfy the second equation, 


Example 58.7 
Solve the equations 
ex + dy = | 
X+ 2y = 2 
over the prime Held modulo-5. 


Multiplying x 2r —2 by 2 gives 2v (4p = 4 and subtracting 20 E dye l leaves 
vy M Substituting r 3 into v E 2r = 2 gives v — L The solution is therefore x= | 
and yw: 3, [L] 


Finite fields are used extensively in the construction and the decoding of codes and 
in Chapter 6 we consider finite fields in greater depth, 


5.4 Vector spaces 

Most readers will probably be familiar with the concept of a vector within a plane. 
Here a two-dimensional x, y coordinate system is used to define the position ol any 
point within the plane, The intersection of the V and. Y axis is the origin ol tho 
coordinate system and has coordinates 0, 0. Given a point P with coordinates : | 
then the vector K = (x, y) is the straight line starting at the origin und ending al 
(see Fig. 51a). If vectors are constructed from the origin to all points within z 
plane then the resulting set of vectors forms a vector space. This is a rather € 
definition of a vector space, a formal definition will be given soon. In a 
dimensions, with axes X, Y, and Z, vectors are denoted by v = (X, V, z) AR t 
z are now the coordinates of points within the three-dimensional EE a 1 
structing vectors from the origin to all points within the space now P inlet 
3-dimensional vector space. Whilst it is easy to envisage and give physici 
pretation to vectors in 2 or 3 dimensions, this is not so for vectors 1n. o nsions 
dimensions. However it is possible to define vectors within 4 or more vt code 
Our interest in vector spaces is because codewords belonging to an (th r} articuli 
can be interpreted as vectors within a k-dimensional vector space, and 1n par 


| 
| 
| 
| 
| 
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Fig. &1 Vectors in a plane. 


multiplication which satisfy the conditions: 


l. The set of vectors f, orms an additive commutative group. Hence for any 2 vectors 


u and " the sum u + v is also a vector (the closure property). Addition is asso- 
aa and commutative. Each vector has an additive inverse and there exists an 
ĉdditive identity vector 0. Hence for any 3 vectors u, v, and w 


u+ (v4-w) — (uv) w 
u+vo=v+y (5.9) 
u+0=u 


u+u'=0 


Whe 
Mui. n the additive inverse of u. 


Iplicat; 
Vectoy y m Of vectors by scalars, belonging to some field, is defined. For any 
Scalar c the scalar product cu is a vector. The scalar product 1s 


> 
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distributive and associative and given the vectors u and v 


(a + b)u = au + bu 
a(u -+ v) = au + av 
(ab)u — a(bu) (5.10) 


lu =u 
where a and b are scalars and 1 is the multiplicative identity element. 


In the definition of a vector space the vectors and scalars can be abstract Objects 
the definition does not specify the nature of the vectors or scalars. The vectors, that 
we are interested 1n are ordered sequences represented by 

y = (vi, V2... , Vn) 
where the n elements v; for i= 1, 2, ..., are scalars from a field and are the com. 
ponents of v. The delimiting commas in v can be omitted and we could equally write 
y (yi2... v). An ordered sequence is also known as an n-tuple. For now the 
scalars are taken to be numbers from the real field but later they will be restricted to 


the binary field. Vector addition is achieved componentwise, that is by adding 
together components in the same position. So given the two vectors 


H — (ui, u2, . o-s Un) 


and 


y = (vi,v3, ..., Vn) 


their sum 1s 


W-—Hu-cv 
- (ui, U2,.. «din T (vi, V2,. n sn) 
zd (uy + Vj, Uo + Y?,..., Un + Vn) 
= (Wi, Was «s Hg) 
| NN ace 
where w;=u;+ v; for i= 1, 2,...,n. Note that vectors within the same vector Sp 


. » rs 
must have the same number of components. The sum of two 2-dimensional - 
in a plane is illustrated in Fig. 5.1(b). The scalar product is also componentwise 


the product of the vector u and scalar a is 
au = a(uy,U2,...,Un) 
= (quy, du, x s a dug). 


Example 5.8 


Given the vectors u = (2, 7, 1) and v = (10, —3, 8) find 
(a) u--v 


(b) 4u 
(c) 2u — 7v. 


(a) 


u+y 


(2,7,1)+ (10, —3,8) 
= (2+ 10,7 — 3,1 4- 8) 
= (12,4, 9). 
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4u = 4(2, fa 1) = (8, 28,4). 


oy — Tv = 2(2,7, 1) — 7(10, —3,8) 
= (4,14,2) — (70, —21, 56) 
= (4 —70, 14 + 21,2 —56) 
= (—66, 35, —54). C] 


ors can be added together to form another vector, furthermore 
y a scalar and adding the resulting vectors will give a 
he idea of forming /inear combinations of vectors, for 
., »,, then the linear combination 


ore vect 
wo or m b 
xiplyin each vector 
i ior. This gives risë to 
"aple given the vectors v1, V2». 
exa 
y = AV] + d2V2 57 + GmVm 
or, where dj, 42, - » - » Am aTe scalars. A set of vectors vj, V2, ... , Vm are said 
, a2 


: a vect ; l ; 
is also dependent if there exist m scalars a), A2, . .. , Am not all of them zero, such 


to be linea rly 
that 

av + d2V2 +++ dy = 9. (5.11) 
Otherwise the vectors are said to be linearly independent. If the vectors vi, ¥2,-.- 5 Ym 
re linearly independent then the only scalars that satisfy eqn 5.11 are 


di cg cm dU. 


If we can find any set of scalars, where not all of them are zero, such that eqn 5.11 is 
satisfied then the vectors v,, v2, . .. , Vm are linearly dependent. However, if eqn 5.11 is 
not satisfied for a given set of scalars then the vectors v1, v2, ..., v,, may still be 
linearly dependent for there may be some other set of scalars for which eqn 5.11 is 
satisfied. The example below illustrates this point. 


Example 5.9 
For each of the three sets of vectors determine whether or not the vectors are 
linearly dependent 


(a) ui =(3, —8, 5), u, = (—2, 2, 14), and uw; = (—1, 6, —19) 
^ n-(, á, A) v2 = (16, Z, =L), and y3 = (6, —12, 15) 
7 ^-(-2, 0, 0), w; = (0, 7, 0), and w4— (0, 0, 9). 


) 
(a) Taki Ex 
aking a, = l;a;—1l,anda4—1 gives the linear combination 


41U, + azu + azu, = H| + u + u3 / 
= (3-2-1, —84-2--6,54- 14 — 19) 
— (0,0,0) 


and therefore t 
" Taking a, =] 


nonzero, Thi 


he vectors are linearly dependent. 


E = l, and a4— 1 gives v,-- v5-- v4 — (29, —7, 11) which is 
ere 22 does not necessarily mean that the vectors are inde- 
ay be other scalars that give a zero linear combination. If we 
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take a, —2, 457 —1, and a3 — 1/3 then 


2v; — v2 + (1/3) 
= 2(7,3, 73) - 116,2, —1) + 1/3(6, ~12, 15 
= (14,6, —6) + (-16, —2, 1) + (2, —4,5) 
= (14 716 -2,6 —-2—4, —6 - 14-5) 
— (0, 0,0) 


and the vectors are therefore linearly dependent. 


(c) Here any linear combination of w;, w2, and w; gives a nonzero vec 
example iie 


Sw, — 4w2 + 10w4 
= 5(—2,0,0) — 4(0, 7,0) + 10(0, 0, 9) 
= (—10,0,0) + (0, —28, 0) + (0,0, 90) 
= (-10, —28, 90). 


Consider aW; + a3w5 + 433, this gives 


a,(—2,0,0) + a2(0, 7,0) + a3(0, 0, 9) 
= (—2a,,0,0) + (0, 7a2, 0) + (0, 0, 9a3) 
e (—2a1,7a25,943) 


and the only way in which (—2ay, 7a», 9a3) can equal (0, 0, 0) is if a; = 42 a7. 
Therefore the only scalars that give a zero linear combination of the vectors vi. 
i 


w2, and ws are aj = a = a3 = 0 and so the vectors are linearly independent. 


_ The ability to form linear combinations of vectors and the property of linear 
independence are quite important, for as we shall now see they simplify the cor 
struction of vector spaces. Within a vector space there always exists at least one sel of 
linearly independent vectors from which all other vectors can be generated. These 
are known as basis vectors and a set of basis vectors is referred to as a basis for ™ 
vector space. Each vector within the vector space can be uniquely expressed si 
linear combination of the basis vectors. The basis vectors are said to spa” the vector 


s Po "ensi 
— The number of vectors within the basis is called the dimension alt 
or space. In an m-dimensional vector space any set of m linearly indepe” ; 
xample le 


vec 
imme, EL x ae space and is therefore a basis for the space. As an © 
a 3-dimensional space over the real field. Here the vectors 


i= (10 0) (5.12 
g= (0 Ll 
k = (0 0 1) 


can beu essed 2 
sed as basis vectors and all other vectors within the space can wer 


———— 
— re, 
m ————ÓÀ | 

— 
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and v; are scalars belonging to the real field andar 


. | | € the project; 
ne y, and Z axes respectively. Substituting eqns 5.12 into i ui 
alon 
y=vx(1 00) + ,(0 10) + v-(0 0 1) 
= (vx 0 0) + (0 v, 0) + (0 0 v.) 
cde (Vx Vy vz) 
rich is the standard form for a vector in 3 dimensions. Equations 5.12 can be easily 
Vende d to an m-dimensional space so giving 
ex 
b, — (10...0) 
b, = (01...0) 
! (5.13) 
b, = (00...1) 


asa set of basis vectors and are referred to as the standard basis. 

The vector spaces that we are interested in are those constructed from binary 
n-tuples, so that vectors take the form of ordered sequences of 0s and Is. Given the 
set of 2" n-tuples it is quite easy to show that under modulo-2 addition a vector space, 
referred to as V,,, is formed. Consider the 16 vectors formed from binary 4-tuples. 
The vector (0 0 0 0) is the identity element and each vector is its own inverse, for 
example (10 1 1) (101 1) 2(1-1,04-0, 1 1, 12- 1) = (0 0 0 0). There are only 
2 scalars, 0 and 1, in the field and as such we need only to consider multiplication 
by and 1. Multiplying any vector by 0 always gives (0 0 0 0) and multiplication by 
| leaves a vector unchanged. Vector addition and scalar multiplication obey the 
required associative, distributive and commutative laws given by eqns 5.9 and 
5.10, therefore the set of 4-tuples under modulo-2 addition form a vector space 
known as V, (see Table 5.4). 

In a vector space subsets of vectors can exist that have all the characteristics of 
à vector space under vector addition and scalar multiplication, in which case the 
subset of vectors is known asa vector subspace or subspace. Consider the four vectors 


(0000),(0111),(1010), and (110 1). 


Taking the sum of any two vectors gives one of the four vectors and the set is 
therefore closed under addition. It is easy to verify that the four vectors satisfy all the 
Conditions necessary to form a vector space and therefore the four vectors form a 
This is not the only subspace that can be formed, for example the 
(0000), (0 110), (00 1 0), and (0 1 0 0) are also a vector subspace of V4. 


" ^ standard basis of V, cannot be a basis for a subspace of V,, because the 
n 


Subspace of Vi. 
vectors 


ard basis, like any other basis, generates all the vectorsin V,,. For example in V4 


Table 5.4 
The vector space V; 
(0 0 0 0) (0 1 0 0) (1000) (1100) 
(0001) (0101) (100 1) (110 1) 
0 0 1 0) (0 1 1 0) (10 1 0) (1110) 
0011) (0111) (1011) 0111 
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the basis vectors (1000), (0100), (00 10), and (000 l) are cle; 

the subspace (0000), (0 1 1 1),(1010),and(110 1) (the 2 basis 
subspace). A set of linearly independent vectors that is ed i me ven b ^ fs oy | 
always be extended as so to form a basis, this is known as dom Pen ofa subs, lO the 
set is not a basis then there exists at least one vector, in the « - of a basi. Ir 

linear combination of the vectors in the set. One of these m Space, that i the 
set and the set is checked to see if it now forms a basis. If the ~ SR r ended to tp, 
the process is repeated, so adding vectors one at a time, u Set IS Still no, Tin, 


ntil the set i« dsi 
the process we only need 2 linearly independent vectors. n 


T $, 
a basis, Ty stan 
Example 5.10 

Determine a basis 


and the dimension of the subspace in V5 consisting of 
vectors INE, of the 


(00000) (11100) (01010) (10001) 
(10110) (01101) (11011) (00111) 


Any 2 linearly independent nonzero vectors, say (1 1 100) and (0101 0), can be used 
as the initial set of vectors. They are linearly independent because if we consider 
v—ajy(1 1 100)-r ax(0 1 0 1.0) then the only values of a; and a; that give v - (ar; 
a, = a» — 0. Of the remaining 5 nonzero vectors (10 1 1 0) cannot be appended to the 
set, because(10110) (11100) 4- (010 1 0) and is therefore linearly dependent on 
the 2 vectors already in the set. Any one ofthe vectors (1 000 1), (0 1 10 1), (11011) 
or (00 1 1 1) can be appended to the set. Taking, say, (0 0 1 1 1) as the third basis 
vector we find that all the vectors within the subspace can be constructed from a 
linear combination of the vectors (1 1 100),(010 1 0), and (00 1 1.1): 


0-(11100)4+0-(01010)+0-(001 1 1) 2 (000090) 
0-(11100)240-(01010)--1-(0011 1) 2 (0011 I) 
0-(11100)-1-(01010)--0-(0011 1) 2 (01010) 
I-(11100)20-(01010)20-(001 11) 2 (11100) 
0-(11100)4-1-(01010)-- 1-(001 11) 2 (01 101) 
1-(11100)+1-(01010)+0-(001 1 1) 2 (10110) 
1-(11100)+0-(01010)+1-(0011 1) 2 (11011) 
I-(01100)41-(01010)--1-(00111) 2 (10001 
1), and the 


A basis of the subspace is therefore (1 1 1 0 0), (0101 0), and (0 Ath 
dimension of the subspace is 3 because there are 3 basis vectors. Tni al 
is not unique, we could have taken (1 0 0 0 1), (0 1 1 0 1), or (1 ! 

vector to complete the basis. 


d 

Jars n 
| . 1 aation only by soa" 

The definition of a vector space requires vector multiplication O m are differe"! 


ipli an 
not by vectors. However vectors can be multiplied ic dap 
ways in which this can be achieved. Consider the two vee 


u = (ui, U2,- » Un) 


and 


y = (vi, V, . ++ Vn) 


BED 
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iso known as the inner product) of u and v is defined as 
aise | 


ict À 
of p" odi 


ihe Á 


uy = UV] + U2V2 + °° t UnYn- 


are vectors the dot product u - v is a scalar belonging to 
ts of u and v. Two vectors u and v are said to be 
dot product is zero 


‘ : y 

pac whilst ^ - onen 
ote geld as the compe 

‘go same 


if their 
ihe sto each other if thet 
pogo" 


u-v =Q. 


a relative property, ifu » v = 0 then u and y are orthogonal 
sarily to other vectors. It is possible for a vector in V, to be 

o itself. Consider, for example, the vector v= (0 1 1 1 1) in Vs, the dot 
g = (0 11 017-0 11 1 1)=0-0+1-14+1-14+1-141-l= 
7 erefore (0 1 1 1 1) is orthogonal to itself. The property of 
ed to construct a second vector space from a given vector 
, then the set of vectors in V, that are orthogonal to the 
f V, and is called the dual space or null space of V. Let 


orthogonality 15 
but not neces 


+ sonality can be usi ; 

"ace If Visa subspace 1n ^, 

sectors in Vis also a subspace O 

ype the dual space of } then 

i V ° Yd = 0 

ior all vectors ¥ and v, belonging to V and V respectively. The property of duality is 

ir te property, but a relative property between 2 spaces. If V4 is the dual 

space of F, then Vis the dual space of Vg. Vectors belonging to the dual space, Va 

have the same number of components as vectors belonging to V. If the dimension of 
ion of its dual space Va is n — k. Over the real field a vector 


Visk then the dimensi 
space and its dual space onlv contain the all-zero vector as a common element. 
However in V, a vector space V can contain vectors that also lie in the dual space of 
V Furthermore the dual space can be a subspace of V or contain Vasa subspace, or 


the space V can be it own dual space. 


not an absolu 


Example 5.11 

Show that the vector space V consisting of the vectors 

(6000). (000 1), (00 1 0), and (0 O 1 1), and the space W consisting of (0 0 0 0), 
11000). (0 1 0 0). and (1 1 0 0), form dual subspaces of V4. 


ng the dot product of first nonzero vector in V with the nonzero vectors in W 


(0001)-(1000)=0-14+0-0+0-0+1-0=0 
(0001)-(0.100)=0-0+0-14+0-04+1:0=0 
(0001)-(1100)=0-14+0-14+0-04+1-0=0. 


Hence (0) ( ^ 

10) and nite orthogonal to all the vectors in W. Likewise we can show that (0 0 

subspaces x Z rm orthogonal to the vectors in W, and therefore Vand W are dual 
4: 1n V the vectors (000 1) and (0 0 1 0) are linearly independent but 


NE Vector (0 0 

11)= : : 
of the dual A: (0010) + (000 I) and so the dimension of Vis 2. The dimension 
Aside Vang is also 2. The reader can verify that no other vector in V4 lying 


IS orthogonal to all the vectors in V or in W. L 


UE 
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Unhke the dot product of two vectors, which gi 


two vectors gives another vector. F 





ves à scala 


sonal vectors 


or exampl à „t 
p expressing a a y Cog, 


u = Med + u, j + uk " | 
Py vs 2- vk 


then their cross product is 


i r 

it 3 ek 
gx? = iy u, u. 

Í Ve Vy y. 


and evaluaung the determinant on the right-hand side gives 


ax yr = (u, v. —u.v, i + (u.v, — uy y+ . 
> ^ - ' , X -— X X 2 s (M. v, Fi P ) 
7" k. 


Note that the end result is a vector. The ability to take the produci of 


mathematical structure above vector spaces namely that of a linear TOOTS Bv 


algebra has all the properties of a vector space but further allows bas A linear 
plication subject to Or mult. 
u*ívew) = (werlew 
usli Wj —í*V--H*w 
(M Y). Ww — H&w--vVe*w (f 
alusy) = (au) ev = ue(av) 


where u, v, and w are vectors belonging to the linear algebra, a is a scalar and e isi 
vector multiplication operation. Both the dot product and the cross product satish 
the distributive rules in eqns 5.14 but neither satisfy the associative rule. The produc 
u* (vew)cannot be constructed when s is the dot product because the first produc! 
ve w gives a scalar say c, leaving uc which is not defined. When e is the cros 
product then u è (va w) and (me v) € w give different vectors. Therefore neither the 
dot product or the cross product can be used to form a linear algebra. We an 
however generate a linear algebra by defining the vector product 


Har — (uj v1, u2V2,. -s UnVn) 


. v,). It can be easily shown that the 


A — : bi rms a linea! 
definition of vector multiplication satisfies eqns S 14 and therefore fo 
algebra. 


where u —(uj, Uu»... .. u,) and r= (vi. v5, ... 


5.5 Matrices 


! 4" 
1, Given aan” 
Here we consider characteristics of matrices relating to inm vt ^ written” 
m matrix A (that is a matrix with n rows and m columns) 
ay; a2 Gim 
a) 422 em ] 
A | 
j 
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_,m. The ith row in A can be thought of as 


J. nandj— L-- 


= 1, 


: ecte Vi — (ài 3 Qj 2; * 2*5 dim) 
vector The matrix A can be expressed in terms of its row 
QW $ 


pod is KP 
actors 4 vi 
V2 
Az! , 
Vn 
fall linear combinations of the row vectors v; forms a vector space referred 
.set ora á mur 
The the row space of the matrix A. 
to as 
ample 5-12 . 
Example f the matrix 


| -— 
Determine the row spac 


1 00 1 1 
A=|0 10 1 0 
DU ti Eu 


The row vectors are y,=(1001 1), v; —(010 1 0), and v, = (00 1 0 1) and taking all 
he 2? linear combinations of vi, v, and v3 gives 
0-v; 4-0»? 4-0-»4 = (0 0 0 0 0) 
pO n 1*5 = v3 — (0010 1) 
yp + lev 0*3 = = (010 1 0) 
o 4-00 +000; — —(I0011) 
yp tlerm + len =r += (011 1 1) 
yp 40-v2 1-4 = vi +¥3 — (101 10) 
p 1*»2 40-4 = vi +H. — (1100 I) 
p Hl.m + l.n =v tr +73 — (11100). 


" row space of A therefore contains the vectors (0 0000), (10011), (0101 0), 
101,(11001),(10110), (0111 D, and(111090). g 


— - FA ae a matrix in terms of column vectors constructed from the 
gives the hold =. -< taking all the linear combinations of the column vectors 

* Tow and Blum e of a matrix. Hence any matrix A determines 2 vector spaces; 
i vector spaces ofi A. The dimensions of the column and row 


S, i 
referred to known as the column and row rank respectively, are the same and are 
as the rank of the matrix. 


Interch 

an In ® L] > 

Mote chan Bing any two rows in a matrix gives the same row space, and further- 
i) BIng a matrix by i 


| 
Merchanging rows 
multiply; 
i 
(c) ada: Ying à row by a nonzero scalar 


Inga mult; 
ultiple of one row to another row 
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produces the same row space. The operations (a), (b) 

elementary row operations, and two matrices that diffe e (c) are kn 
operations have the same row space. If the elements of a ay b 
field then the row operation (b) is trivial and (c) simplifies 


to another row (since the only nonzero scal 


elem 4: 
Atrix belon is 


to th as eh; 
aris |), © addition Of one I 
OW 


the 
ty [oy 


Example 5.13 

Consider the matrix A in Example 5.12. Adding row 3 t 

Skies d T O ro 
interchanging rows 2 and 3 gives w land then 


tO d 
AI 0 | 
0 1 0 


show that the row space generated by A’ is the same as that generated by 4 


The row vectors are now (1 0 1 1 0), (0 0 1 0 D, and (0101 0). Taking all the 
8 linear combinations of these 3 vectors gives the vectors (0 0 000) (10110 
(00101)(01010),(1001 D, (11100), (0L L1 1), and (1 1 00 1). This is the 


same set of vectors as obtained in Example 5.12 and therefore the row space pen- 
erated by A and A’ are the same. D 


5.6 Linear codes as vector spaces 


In Chapter 2 a definition of linear codes, based on the property that the sum lur 
codewords gives another codeword, was given and codewords were loosely re : T 
to as vectors. Here we consider a definition of linear codes based on the concep 
vector spaces. ^ , bit 
Given an (n, k) code two sets of words can be defined. The first 1s the i M a a 
words which form the vector space V,,. As a vector space Vn has the je addition 
elements, that is the vectors, form a commutative group, over which v ommutativ 
and scalar multiplication can be carried out such that the ——a second, tl 
and distributive conditions given by eqns 5.9 and 5. 10 are — The requirement 
smaller, set is formed by the 2“ codewords, which we denote n edi vector sp? 
for linearity is now that the set of codewords C, forms a subspa 
V, and so an (n,k) code is said to be a linear cod -—— 
k-dimensional subspace of the vector space Vn. —— codewords 019^, 
vector space is also a vector space, we see therefore that onal vector space yu 
code form a vector space. We have seen that in a k-dimens! ; which span 
exists at least one set of k linearly-independent basis "—- "nbinations of the 
space, such that the vectors in V can be formed by linear trix G form a se peset" 
vectors. For a linear code, the rows of the generator ee m enerates 
vectors for the code, and taking all combinations of the ro 
codewords. 
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0 1 1 
L @ LI. 
1 1 0 


e codewords can be generated by taking linear combinations of the 


4 | 
pampe $^ has generator matrix 


6 
The | 1 0 0 
G=|0 1 0 


0.0 1 





show that th 
rows of G. l 
Taking linear combinations of the 3 rows gives 

row 1 2 (1000 1 1) 

row 2 — (0 10 10 1) 
row 3= (00 111 0) 

row 1 -- row 2 — (1101 1 0) 
row 1 -- row 3 2 (101 10 I) 
row 24- row 3 — (01 10 1 1) 


row 1 - row 2-- row 3 2 (11 100 0) 


which, along with the all-zero codeword (0 0 0 0 0 0), are the 8 codewords of the 
(6,3) linear code (see Table 2.2). = 


Recall that for an (n, k) linear code, the generator matrix G has k rows, which we 
now see are k linearly-independent vectors (row vectors). Denoting the k rows of G 


by the vectors g1, 82, ..., gx We can express G as 
81 
85 
OR. (5.15) 
Bk 


To check the linear independence of the row vectors we need to.consider whether 
Aig, + A282 H't + AB =0 


whe j i 
ue € 11, 05, . .. , ay, are 0 or 1. If the row vectors are linearly independent then the 
y condition that satisfies the above equation is 


a =a =:::=a,=0 


Otherwj 
“Twise the rows of G are linearly dependent. 


Example 5,15 
Onsider the 


OW that e 3) code whose generator matrix G is given in Example 5.14. 


row vectors of G are linearly independent. 


“= m ad. ——  — 
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Uhe rows M Game 
B= (100011) 


& = (010101) 
&|1-(0011100) 


acd io cheek for linear indepeadence we consider value 


8 Of ay, ay 
ad T and q f 
vor Whi 
ch 


HR apo + an = 0. 


Pakana all 8 combinations of ap da and ay gives 


Oe Oga tO g = (000000) 
Org, +0-g) 1:8 (001110) 
vg tlg t0: (010101) 
Og, + imr lg, = (011011) 
Leg) 60: +058, = (100011) 
m tOn + lg = (101101) 
gut lb +0 g = (110110) 
l-g tl-gy+l-g,;=(1 11000). 


Hence the only values of ap a», and ay that satisfy the condition for linear inde. 
pendence is 


aay Q3 mod mU 


and therefore the row vectors gi, ga, and g, are linearly independent. Note that the 
remaining 7 combinations of a), à», and ay have generated the codewords, [] 


A codeword e can be expressed as a linear combination of the row vectors of G, 
that is 


C= agi + ag» 4T GkEk (5.16) 


where apas... a} are O or 1. The codeword for an information -— 
Uh. in... dg) is given by e = iG. Using the generator matrix, in the form of eqn >.> 


we get 
c — iG 
E» 
£2 
= (iy, i2,. "T 
Ek 
and so 


(5.17) 
c = gig; ge 


— 
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d 5.17 we see that each information word i generates a 
as eqns 5.16 " nd code's basis vectors and therefore gives a different 
o ‘ ` 


ik E * * > 
compa! bination , c=iG can now be interpreted as generating differ- 
jerent 8^7. ualon m 
jte The €4 
AU y 


i i -the code's basis vectors, as given in G, according to the 
ew sions OF UM * 
eV + 
phi , 
t Oon wordi 7. 4) code can be expressed as 
amatio! atrix of the (7. 4 
ho GNET 
fhe S £i 
lia: 82? 
83 
84 
where the TOW vectors 


g = (1000101) 
g>= (0100111) 
g; — (0010110) 
g,- (0001011) 


iorm a basis for the code. Codewords can be expressed as 
€ = 18, + hg, + ig; + lag, 


where = (i h, h, i) 18 an information word. Taking any information word, say, 
i=(1010) gives 


c=1-8,+0-g,+1-9,+0-g, 

= 21 83 
=(1000101)+(0010110) 
=(1010011) 


Which is the codeword for 


i — (10 1 0) as given in Table 1.6. 
On a practical point, th 


e results of this section show us how to construct code- 

Words from generator matrices without the need of matrix multiplication. Given a 
t G, the complete set of codewords can be obtained by first writing 
len eves n IN dual rows, followed by every combination of 2 rows added together, 
y combination of 3 rows added together and so forth until all rows are 

e last codeword. Example 5.14 gave an illustration of this. 
deword for a given information Word i, we add together the 


to the Is in é, as indicated in eqn 5.17. Rows corresponding 
Nf are omitted (see also Section 2.2), 


dded together to give th 


the "PPropriate rows of the generator matrix determine 
information words 
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The generator matrix for the (7, 4) code is 


100010 4 

[IO 100 1 1 | 

C= 10 0 l O 1 1 0 

V0 0.1 6 2 ; 

(a) For ij z (0 1 0 0) we get 
T 0 100 10 1 | | 
c — (0100) 00101] 5 | 
000 10 1 | 


and clearly we only need to take the second row of G to 


ge-(000pi,. 
(b) For i» — (1 1 0 1) we add together all the rows except the third row, Which on — 
c=(1101001). sae 


(c) Here we add together the middle two rows, so giving c- (011009 n | 


5.7 Dual codes 


cage gE 


We have previously considered how the 
be used to generate the code's dual C 
context of linear codes and vector spa 
linear code. Like the rows of the gene 
matrix are linearly independent and t 
spaces generated by G and H are dual 


parity-check polynomial ofa Cyclic code can 
ode. Here we reconsider dual Codes in the 
ces. Consider the parity-check-matrix H of à 
rator matrix G, the rows of the parity-check 
herefore generate a vector Space. The vector 
spaces, so that any vector in one of the Spaces 
is orthogonal to all the vectors in the other space. Recall that the parity-check matrix | 
H, for an (n, k) linear code, is an n — k by n matrix, so H has n — k rows. The vector | 
space generated by H therefore has dimension n — k and contains 2”-* vectors. 
Compare this to the vector space generated by G which is k-dimensional and con- 
tains 2^ vectors. Hence the number of vectors in the vector spaces generated by Gand 
by H will usually differ. The parity-check matrix of a linear code can clearly be used 
as à generator matrix to generate a linear code. Furthermore as the vector spaces 
generated by G and H are dual spaces, the linear code generated by H is the dual 
code of C and is denoted by Cy, where C is the code generated by G. The code C; 
is not a dual code in an absolute sense but only relative to the code C. We can 
equally say that C is the dual code of Ca. If C is an (n,k) linear code, then : 
has blocklength n and inf. ormation length n — k, so that Cais an (n,n — k) linear Co Y 
Note that although the blocklength of the codes are the same, the code C contain 
codewords, whilst its dual code C, contains 2"- * codewords. then 
Let G, be the generator matrix of the code that is dual to the (7, 4) code, 
G4 — H the parity-check matrix of the (7, 4) code, and so 


1110100 ($8 
Gi=|0 1 1 1 0 1 Of. 
0 100 1 
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binations of the rows of € Bi veh the & codewords of the dual 

att the com^! le 5.5(a) (this is the same set of codewords given in Table 4.4 
aking ^, un in 1 ur convenience), The order in which the codewords appear 
code 4 roduced here ined by the order in which the row vectors of Gy are com. 
and. s(a) is deter Fhitesrs- Thavedownnds appear in a nonsystematic form, bis 
| ‘ therefore 2 e systematic form shown in Table 5,5( b), The dual code's 
ran prd length are n and n — k respectively, and therefore the 
"ockleng! rays the (7, 4) code is a (7, 3) code (as we have already »een in the 
e that 1s dua odes). Codewords e and ca from the (7,4) code and the (7, 4) cade 
clic Md " : onal, so that the dot product of e and Ca 18 0047 0, For 

“> sso pedewendad] 01001 1) and (010011 1) from the (7,4) and 


» given i 
mple £ respectively then 


examp | 
he (7,3) codes 


ecg — (101001 1)-(0100 1 TI) 
=1-:0+0- 14+1-0+0-0+0-141-,4].] 


sare therefore orthogonal, 
and the codewords are there | | 7 
The (7, 3) code should not just be thought of as the dual code of the (7, 4) code, 
but as a linear code in its own right with generator matrix Ga given by eqn 5,18, 
The matrix Ga can be easily put into a systematic form to give 


G-|0 1 00 1 1| | (5.19) 
0 0 1 1 1 0 4 


454 Systematic generator matri 
Wecan see that the codewords 
(7,4) code. Hence the (7, 3) lin 


x of the (7, 3) code, Referring to Tables 5,5 and 1.6, 
belonging to the (7, 3) code are also codewords of the 
car code is a subspace of its dual space, such a code ís 
ode. Each codeword in the (7, 3) code is therefore 
dewords within the (7, 3) code. A linear code can also 


known as a self-orthogonal c 
or 


thogonal to all the other co 


Table 5.5 
The (7,3) code 


(a) Nons ystematic codewords (b) Systematic codewords 
0000000) (00010000) 
0 10 0) (001|1101) 
11010) 0010/0111) 
001) 01111010) 
110) (100|111 0) 
10 1) (1011001 1) 
Hü (110]|1001) 
onion 
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be equal to its dual code, in that the two codes have the Sa 


i me set 

which case the code is known as a self-dual code, We have seen den h Odeword, i 
t) code is an (7, n — k) code. Therefore a self.d. ed , 
an (7, k) code is an (zi ) Ore a self-dual code must hay, Code 


that isk — 71/2 and so a self-dual code with blocklen 
even integers n there exists an (7, 71/2) self-dual code, fo 
is self-dual. Recall that the dual of a code, with generator matrix G ;,. ' ^ “de 
by the code's parity-check matrix H, and therefore a self-dual mde 


Furthermore if G — [I |P ] is the generator matrix of a self-dual code. t 
square matrix that satifies PP! — 7 


gth n is an (n n/d on nk 


as Hz 
hen Pig, 


Problems 


5.1 Determine whether the followin 
(a) Sy — (El, £2, 3,...} 
(b) $5 = {0,1,2,...3 
(c) S3 = +0, Ru EG, es ` 
(d) S4— (0, +1, +3... 


J 


£ sets form additive groups: 


^" * * * 


5.2 Construct the group of integers under modulo-6 addition. 
5.3 Determine whether the followin 
(a) The set of real numbers 
(b) The set of positive real numbers 
(c) The set of negative real numbers. 


3.4 Show that modulo-8 multiplication over (1,2, 3,4, 5,6, 7) fails to form a 
multiplicative group. 


g sets form multiplicative groups: 


9.5 Construct the prime field under modulo-5 addition and multiplication. Find 
the multiplicative Inverse and additive inverse for each element within the 
field. Repeat for the modulo-7 prime field. 

5.6 Evaluate the following expressions under modulo-5 arithmetic: 
(a)2x7+6 
(b) (4~8)x 3-2 
(c) (3 + 6)/2 — 4/3, 

Repeat using modulo-7 arithmetic. 
5.7 Solve the simultaneous 
3x+y=2 
2x+3y=6 


equations 


, have 

defined over the prime field modulo-5. Show that the equations ia 
à unique solution if they are defined over the prime field -— | 1,20 

5.8 Show that the set of vectors (0 0 00 0), (0 10 10), (1100 D 0 
(10 1 1 0) does not form a vector subspace of Vs. 


5.9 Find 3 vectors such that when added to the set of vectors in 


| is for the 
resulting 8 vectors form a vector subspace of Vs. Find a m 
Subspace and the dim 


ension of the subspace. $11 1 0) and 
5.10 Determine whether the vectors (0 1 10 1 1), (1101 10 ( 
(11001 1) are linearly independent. 


5$ the 
problem vector 








at the row space of the matrix 


show th 
sn S 10 0 1 1 
G-—-|0 100 I 
0.0 1 ! 1 
x the codewords of the (5, 3) linear code given in Table 2.3. 
sho that the row vectors of the matrix 
s {2 MOT 
| 1001 110 
G—-|0 1 00 1 1 I 
0.0 1 ] 1 0 | 


sre linearly independent and that the row space of G gives the codewords of 
ihe (7,3) code given in Table 5.5. 


«13 Show that the (8,4) code with generator matrix 


1000 101 1 
. [0 100 1 1 1 0 
06-7l00 10 1 1 0 1I 

D à O 1 O--2-4 


is self-dual. 


VH Show that every codeword in the (7,3) code is orthogonal to every other 
codeword. 





Galois fields 





We have seen that the mathematical framework for linear co 
are matrices and polynomials respectively. For each type of 
decoding can be concisely formulated in terms of their respecti 
difference in mathematics signifies more than just mathematic 
in going from linear codes to cyclic codes there is an increas 
ematical structure, Moving on, from cyclic codes to the ne 
greater mathematical structure are the BCH codes, conside 
mathematical framework within which the BCH 
Galois fields and it is these that we consider next. 


des and Cyclic Codes 
code, encoding ang 
Ve mathematics This 
al representation, for 
© 1n underlying math. 
xt level of codes With 
red in Chapter 7 The 
codes are addressed is that of 


6.1 Roots of equations 


We have already considered fields, in particular finite fields, in Chapter 5. Here we 
are interested in finite fields constructed from the roots of equations. The motiva- 
tion for this approach lies in the property of cyclic codes that all codeword poly- 
nomials c(x) have the generator polynomial g(x) as a factor. This can be restated by 
saying that any root of g(x) = 0 is also a root of c(x) = 0 and it is the exploitation of 
roots of equations that takes us to the BCH codes and to the finite fields relevant to 
the codes. 
Consider the a/gebraic equation of the form 


d 
anx” "T "PN T. isla Tc ajx? -C-ajx-4 ao = 0 (6 | 


where ao # 0. For now the coefficients ao, a4, . .. , a, are taken to be real m 
later we consider eqn 6.1 when the coefficients are binary. The simplest — 
equation is the equation of first degree obtained by setting n= l, this 1$ U 
written as 


ax+b=0 


ad- 
: degree (qY 
where a = aj, b= ag and there exists one root x = —b/a. The second deg 

ratic) equation, commonly expressed as 


é rmulà 
. ous fo 
where now a = a», b = a, and c = ap, has 2 roots given by the fam 


solving quadratic equations 
(62 


— 


=- 
~ 


—b + Vb? — 4ac 
UTE eee 


L2 ——— Le A 
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equat ons of | 


Q0 vere. d | y 
ols . ined d F. ' j- "ei q ` Y 
"ikv eS been shown that it is nol possible to solve the fifth-degree 
ane or it D | 


I^ 
^ hie ' ' Pa i i ^ seq i s acl 
eq ion ust ots algebraically. T his was established in the early 19th century 
l erouis wo" 


expres vith degree n, as given by eqn 6.1, has n roots. There is, however, one 
lem regarding the nature of some of the roots. Returning to the quadratic 
m oblen > m 

slighi prol ! by + c= 0 and setting a = c = | and b = 0 gives 

ation a 
equatit 


x? 4-1 20. (6.3) 


cof eqn 6.3 has the property that when multiplied by itself it gives —1. But 
u * ro s T ' " ` E D 
- ire no real numbers that have this property and the only way of obtaining 
Uere i Á ‘ 1 i ) | / j y ] ^1! 4 ' j ^v 3 i a 

| ; bv de a ne or complex number j, w 
ots for eqn 6.3 is by defining a new imaginary « iplex number j, which 


satisfes 


f+ =0. (6.4) 


The number j can be combined with 2 real numbers p and q to give the complex 
number p+ jq. Addition and multiplication over the set of all complex numbers 
obey the rules described in Section 5.3 for a set of elements to form a field. and the 
resulting field is known as the complex field. It is because of the existence of the 
complex field that all equations of degree have n roots. The roots to eqn 6.1 are 
ofthe form p + jq with real roots having q — 0. If we consider a quadratic equation 
with ^ 0, for example 


x! —4x-4- 13:20 


RM 6.2 we can easily find that there are two complex roots 2 -J3 and 
hia te rg ol an equation with real coefficients, always occur in pairs 
umber p o ~ e s anjugates or conjugates, which take the f orm p jq. The complex 
Tu ead NM » ol p jq, and likewise p +jqis the conjugate of p — jq. 
complex rogi € aue an odd number of complex roots, this would require 

ut a conjugate. In a cubic equation the roots are either all real 


Or here IS 
S one real " 
ols of root and two roots that are complex conjugates. For example, the 


3 
"- x” — 6x* + 13x - 20: 0 
X tjand|. j2 
"COmploey falas, 

dement, mplex field Includes all the 
Cal field liit». - Wecan think of 
dnd the “VE Started Witl 
n i 1. In thi 

teal fig plex field 


real numbers as they can be considered as field 
the complex field as expanding or extending the 

idedanen S sense, the real field is referred to as a base field 
Briss mu REN the complex field is an extension of the 
Our, ereas the roots Rh l "4 In eqn 6. l belong to the base field (i.e. the 
ence o complex , etong to the extension field (i.e. the complex field) 

PICK roots as conjugate pairs is necessary for the coefficients 
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to lie in the real field. To illustrate this, let's try to construct 


with 2 roots that are not conjugate pairs. For example let | 4 s quadra 
a quadratic equation, then the quadratic equation will be Jéand 3... j 


ti 
S "QUatio 


MI 
ix - (1 t j2))(x ui L. )4)) zl m (4 ~ IZ) +. (11 +2) 

which has coefficients in the complex field. It can be easily show | 
ficients of a quadratic equation, with complex roots, lie in the real field "^ iu 
must form a conjugate pair. then the rog, 


Example 6.1 


If p+jq is a root of a quadratic equation with teal coefficients, show that 
conjugate p — jq is the other root. at if 


Let a 4- jb be the other root, then the quadratic equation is 


‘ 


(x — (p + j9))(x — (a + jb)) =0 
which gives 


x* — x[(a + p) 4- j(b + q)| + (pa — qb) + (aq + bp) = 0. 


If the quadratic equation is to have real coefficients then the com 


nplex terms must 
equal zero, and so 


b+q=0 
aq+bp=0 


which give b=~—g and a=p. Hence a+jb=p-—jq and so the two roots ar 
conjugates of each other. 


w— 

We next consider roots of equations of the form p(x) =0 where aider 
nomial with binary coefficients. As we have seen such — "lel and 
encoding and decoding binary cyclic codes. The trivial cases o A quadrati 
x^-- 1 20 have 1 as a root, in the latter case | is a double root. 


equation "T 
X xe nen se eqn 62 

ing this because"? 
presents more of a problem. We cannot use eqn 6.2 for solving Since x c 


has a 2 on the denominator and 2 — 0 when using modulo-2 rar ets 
only have a value of 0 or 1, we can substitute 0 and | - d so 0 is EE 
Which, if any, is a root. Substituting x — 0 into eqn 6.5 un of eqn 6.5. AS ano 
Likewise x = 1 gives | and therefore neither 0 or | are roo 

example consider 


(6.6) 
e+x+l=0. > a binary PY 
v te 
. in we hav oun 
Substituting x —0 or x= 1 into this gives 1, and so A800) i uation e? jos 
nomial without any binary roots. This is analogous : int 


; tion 
previously where we considered a real quadratic -— iso. 
the compiex term j is ‘invented’ to get around the p 
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by defining a new term such that it is a root of the polynomial of 
anner a consider eqn 6.6 instead of eqn 6.5 as this proves to be more 
interest. "rendi use j to denote a root of eqn 6.6, but this may cause confusion 
interesting: in ordinary complex numbers. Instead it is conventional to use o to 


with the ^ re re defined root. Substituting x = a into eqn 6.6 gives 


o+tat+1=0. (6.7) 


6.7 may define the new root a it tells us little else about it and further- 

ai 2 more roots of eqn 6.6 that we need to find. We know that a does 

more thet a the binary field and to proceed further we need to determine the 

a — sl structure of the field within which o lies. The root o lies within a 

es as GF (2°) which can be generated from eqn 6.7. Once GF (2°) 
or tei established the other roots can be found. 


Whilst € 
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The field GF(2°) can be generated from the newly defined element o given by 
eqn 6.7. First consider addition and multiplication of o with the binary numbers 
0 and 1. The binary numbers 0 and 1 form additive and multiplicative identity 
elements respectively, so ! 


a+0O=a 


al = a. 
The additive inverse of a is o itself, as can be easily shown 
ata=la+la=(1+lla=0a=0 
and so 
ata=Q0. 
Furthermore rearranging this gives 
Q = —Q 


and-therefore subtraction and addition of a are equivalent. The multiplicative 
inverse of a is defined as 


SO that 


Table 6 
48 . ; i , 
ht eqs “mmarizes the identity and inverse elements of o. 


defined, fore $ implicit that o^ = aaa and likewise other powers of o can be 
Xample o^ = aa, Higher powers of a can be determined by rearranging 








ES | alnis tells 


Lalile f.i 
llentity anl inverse elementa of i 


Identity elementa \ilelitives () wn ea 
id 0sg 

Multipli ative l. alan 
Mean elementi Ade litives iv. Cobh = A 
Multipli ative oy ot oy 


eq f ! in Bie o" («| | (Qr ecall ul (0. 


| | 0, repeatedly multiplyin 
substituting o dE bora whenever appear | 


i 4 hy (V | 
e Marting et with a! » 


F. iE | 
i | 
(y. (MY 99 CRA | |) ij | dà 
v^ e aas e ala! pa) ea kal al bad | (6.8) 


ü ^ ) i } J 
(w^ 5 00 saa E ocdl)en Cal nwen! 4 [. 


— À i - \ MU A ' 
Ihe tour elementi ac 0, o^, and a^ differ from cach other and from the four 
! i 
elements 0, L o, and o. F'quations 6N are referred to as the polynomial repre 
\ i} ' | 
ventations eb the elements e on o and a^. imay appear that other elements can 


be constructed by taking Parther powers of a. This though is not so, for the next 
power of o gives 


( TM e(l d OL) Th asalta | 
and therelore 


wo | 
' * " ay i J Y 
which is an exiting element. Forming Parther powers of à always generates onc el 
the existing nonzero elements, For example, the next three powers give 


Qt sm (V el ( 
u ‘ 
(Y cree” em ACY - a 


! Y ) \ 
at Od (vide ( . 


| | á ith powerol 
A field element with power greater than 6 can be reduced to an element = dulo. 
: i THE $ j ei at i 
6 or less by removing Factors ol o ^, This is equivalent to taking the power! 
l'or example 
al? s ala? s a I2 9 § modulos?) 


al! s alata’ c a M7 3 modulo-7) 


| with 
t ti $ à " ` | cled a sel 

and so forth, Taking into account 0 and 1 we see that we have constru 

the 8 elements 


(), Laar a a* aS and a’, mely 
| sid, nam 
^ | | liis s] seat forms a field: 
long with the operations addition and multiplication the set forms ^. 


ù 
| umber 
" ' i $ w 4 : H 4 y n nite n ite 
the field GF). Unlike the field of real numbers, which has an ! therefore 4 n 


1 Ex “oj * 4% Jd 18 
field elements, GE(2 has a finite number of field elements and i 
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are also referred to as Galois fields after the mathematician 
11-1832). The fields are usually expressed as GF( p") where 
ments in the base field, which is referred to as the field's 
he degree of the polynomial whose root is used to construct 


n 


nite fields 
Galois (18 
umber of ele 


= rder of the field 1s given byg=p . 
ements of GF(2°) along with the polynomial repre- 


Table 6.2 3 xf, a”, and of in terms of 1, a, and a. We have already seen that 


field. Fi 
Evariste 
js the n 


character 


Theo 
the field shows the 8 el 


ions ofa ,Q 


sentatic 0. likewise any field element added to itself gives zero. For example 


aT? 
o? 4- à? = 1o? + 1o? = (141) =0. 


eld elements can be added together by using their polynomial 


different fi . 
= For example, adding o and o? gives 


representations. 


af +a = (à? +a) + (o^ -1) 2a 4-12 o. 


Example 6.2 , 
Find (a) a^ +a, (b) o^ +a + 1, and (c) a dua 4-1. 


(a) From Table 6.2 we see that o^ a — a*. 


(b) Here we first rewrite a? in terms of its polynomial representation and then 
cancel out equal field elements 


c +a+1=(a?+a+1)+a41=a7. 


6 


(c) We can express a? as o^ + 1, and so 


a°? +a? 12 (0? 1) co? 12 0. 
- O 


] "i the polynomial representation of field elements to add 2 elements together 
rather tedious. It is easier to construct a table showing the results of all additions 


and th ua 
within GE) to the table when needed. Table 6.3(a) shows addition of elements 


Table 6.2 
The field elements of 
GF(2) 
silane camara 24, REM 
0 
1 
Q 
e 
a =a +1 
af = a^ “Or 
o =a" +a+] 
a® =" +1 





T—-————HÀ G— 
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Table 6.3 
Addition and multiplication in GF (2°) 


(a) Addition (b) Multiplication 





2 4 5 
+ 0 1] a a «a a@ oq a x oO 1 2 
Q Q o? o^ : 
2 3 4 a (6 
0 0 l a o^ «cq wc w o^ 0 6 Ü- 6 4 5 Q 
3 6 5 4 
t 1 U-uw ew og uw uw et TB qe gg ca 9" X og 
3 4 1 2 6 5 Q a’ 5 
a a a O0 q Q Q c a U a og g ahs a 6 
5 3 
cà o a a 0 ča l 0g æ o* 5 yi a | 
3 3 1 5 0 6 2 4 3 3 4 x 2 1 
Q Q Q Q , Cx Q Q Q 0 a a as af 1 Ly 
ai o*ó d oc a a 0 1 o oa 0 a æ o6 1 o "E 
6 3 2 Q 
ao o a a od al 0 oa a O oó at I. , € o 
6 6 2 5 4 3 6 6 Co WO wy d 
ao a a « l a" @ @ Oo oca OD g* 1 a ÀÜ 4 Q 


Multiplying two field elements together! is straightforward, their powers are added 
together and because a’ = | factors of a’ can be removed. For example, the product 
of a? and af gives 


o af ne at is o? dis. a! o? - lo? = Q. 


This is the same as taking the sum modulo-7 of the two powers. In the above case we 


have 3 + 6 = 2 modulo-7 and the resulting field element is o? as obtained. Therefore 
the product of the field elements a’ and o? in GF (2?) is 


oe in oU )modulo-7 


Although there is no need to refer to a multiplication table when multiplying field 
elements, one is included for completeness (see Table 6.3b). 


Example 6.3 

Find (a) aa, (b) o*o?, and (c) o?afo^. 
(a) ao? — af 

(b) ata? =a’? 2 alo? =a" 


(c) qafat 2 a? =a a a =a. ~ 
For any field element a! in GF (2°) we have 
o! 4- oj = la! + la’ = a‘(1 +1) 20 


inverse of 
and therefore each element is its own additive inverse. The multiplicative 
a' is defined as the element a~‘ such that 


and is given by 








| 
| 
| 
| 
i 
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i47 i 


" nA ^ j «c ] 7 -— ' 
i with a^! gives aa * =a" "a = Land so a” satisfies 


duct of « luli ai "nec D 
Taking = ae for a multiplicative inverse. Take, for instance, the multiplicative 
ent for : 


squirem 
the an E 
verse Ol € 
inver® »- 1-3... 
Q = Q = AQ 
^ Į te . : 

h multiplicative inverse of o? is o*. Note that the element 1 is its own 

the 
and SO i eT 

itiplicative In Verse. "M o. 2 | 

mulllp a field is that division by nonzero elements is possible. 


“she requirements of 
f the require ion ^" 
i n and œ in G F (2°), where a’ #0, then a' divided by a" is 
Given a « 
a — 
—=QO”" zm 0 
Q? 


(i—}\modulo-7 


/is the multiplicative inverse of o^. Note that if i — j < 0 then (i — /) modulo-7 


herea asi TE 
à found by adding 7 to îi — J. Also if i= j then clearly a'/a’ = 1. For example 
a? 6, —2 (6—2)modulo-7 4 
—— zy Q “=a ey", 
EE 


The above calculation can also be thought of as follows 


6 
€ 6, -2 6(,5 — gll modulo-7 _ 44 


* . . " pi . 
where we have now made use of o? the multiplicative inverse of o^, either way the 
same answer is obtained. Consider a divided by o?, if we use the multiplicative 
inverse of o?, which is o^, we get 


L MNT 2 3 
p 


or without using the inverse we can view the calculation as 


Q — — -— m - 
m = o 5 - ql! 5)modulo-7 - a! 4)modulo-7 - o. 


Example 6.4 

Find (a) a?/a°, (b) 1/a, (c) a3/a, and (d) a/o?. 

(a) The Inverse of o? is o?, and so o^ /a? — aa? =at. Or we can view this as 
o^ a? = af- 5)modulo-7 _ af 

(b) l/a= 9° 

(c) o [o — o? 

(d) 6f n... o. 


L] 


We now 
Y gos n m to the problem of finding the three roots of the binary equation 
OGF v = Section 6.1). We have already ‘found’ | root, namely o belonging 

Xt we will use a trial-and-error method to test the other elements of 


O see j ; 
€ if they satisfy x? t x-- 1-0. Only 5 of the 8 elements need to be 
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considered as a is a root by definition and 0 and 1 are known notto b 
e 7 ge 
with x — o^ gives € TOOfs, Startin 


a+ +1=1+1=0 


c ? is a root (here we have ref. 
ind so o isa ( erred to Table 6.3(a) to get o? tai T 
try x —a Next 


o^ co^ c1-a'oc? có 1-20? caza 
and so o^ is not a root. Continuing with x = af gives 


q^ a? leo ETEISEEN, 


and therefore a” is the third root. The elements o? and af cannot be roots because 
cubic equation can only have 3 roots. As a check, substituting o? and a? int 


X +x+1 gives a^ and a respectively, thus confirming that they are not roots 
Therefore the three roots of the binary equation | 


x--x-120 


are the field elements a, o^, and af belonging to the finite field GF (23). Hence the 
original aim of finding the equation’s roots has been achieved. 

In Section 6.1 we considered equations with real coefficients and complex roots 
and the idea of base and extension fields were introduced in the context of the real 
and complex fields. The real field is thought of as the base field containing the 
equations’ coefficients. The extension field contains the base field and extends it to 
include the complex roots. In the present case the equation of interest x -x4l =0 
has its coefficients in the binary field and its roots in GF (2°) . The binary field is 
denoted by GF(2) as it is a finite field with 2 elements. The field GF (2°) is an exten- 
sion field of the binary field GF (2). Note that GF (2°) is not the only extension field 
of GF(2). The field GF(23) has been constructed by determining the roots of 
the polynomial p(x) = x? + x+ 1. Other extension fields can be generated using ~ 
ferent polynomials. However, not all polynomials can generate extension fields, this 
is considered further in Section 6.5. 


6.3 The fields GF(2^) and GF (2°) 


brief look 
Here we are going to first construct the finite field GF (2") and then = in an 
at GF (2°). GF (2°) isa field that the reader will encounter in most text sot have or 
control. GF (2°) was constructed using a cubic polynomial that does 
as roots. Consider the polynomial 63) 
p(x) =x*+x+1. 


four 
Neither 0 or 1 are roots of p(x) = 0, it can be easily seen that p(0) =P (1) be one of 


let o 
roots of eqn 6.9 therefore lie outside the binary field GF (2). If we 


D 
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0 by definition and 


then p(@) = 


o^ - o 4 1-0. (6.10) 


rate GF(2?) in the same way as eqn 6.7 was used to 
lements 0 and | are again additive and multiplicative 
nts of à respectively. To determine the elements of GF (2^) we proceed 
ner as when constructing G.F (2°), by forming successive powers ofa 
generated. Rearranging 6.10 gives 


‘on 6.10 is used to gene 
v" (2°). The binary € 


enerate GF 


identity eleme 
in the same man 
until an existing element 1S 


af =atl. (6.11) 


s of a eqn 6.11 is used to reduce field elements to 


higher power 
4 and successively multiplying by a gives 


When constructing : | 
Starting with a 


their lowest power. 


g^ cd 

55 =o =olat T) ea +e 

6 5 2 $ d v (6.12) 
of = ao? 2 o(a^ --a) 2 à +a 


4! « ao =al 4- o?) 2 o* +a? 2 o^ t act L. 


2°). However, here a’ differs from all the 


at at this point a^ — 1 in GF( 
tinue producing higher powers of a until an 


Note th 
we therefore con 


previous elements and 
existing element is obtained 


-aa — ala - a 4 1) 2 à 4 o^ * a 


7 aal — a(o? -- o? - a) 2 o? toe c a L. 


All the elements generated so far are different, so the process is continued 


NT — aa? — a(o? o a 1) 2 o? & o^ 1 


a e anl? ale «al «E T) +! 


and finally 
al = aa = a(a? +1) =a'ta=l1 


which is an existing element. Constructing further powers of a will always give 


existing field elements, for example 
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The field GF (2^) therefore has the following 16 elements 


Ü, l (x, a’, a’, a^, o, a", a, af, a’, a. q! , o"? o! 
, 


; al^ 


Table 6.4 lists the elements along with their polynomial representa 
|, œ, o^, and a”. Field elements of GF (2*) can be added toget 
polynomial representation of elements given in Table 6.4 or b 


addition table (see Table 6.52). 


tions j e 
TMs o 


Table 6.4 
The field elements of GF(2*) 


0 

| 

CY 

a? 

a? 

a* — a 4-1 

= +a 

af — o? 4- o? 

a! za --a41 
a* — o +1 
= +a 

a" — o? o 4 1 
al! 2o? o? a 
a = o? a 1 
a 2o? 4 o? 41 
a^ =o 4 1 





Table 6.5(a) 
Addition in GF(2^) 





1 Q d a a^ a al ab 49 42 a a at a! a a 
a a 0 oo o 1 có! al! a a! g a® a a" a "D 
a^ o o 0 É o" q og a | a! a4 o a, a” : 

a al? ag? a p a o!" o? at a a o" œ a ^n " 
a a 1 a" a’ 0 œ a? Ææ œ g^ æ a” “ià » NT 
«c a" 6g a a! Æ Q Æ a at af 1 o iei: ^ 
a a" a! y! y a? y 0 a y^ a o a p^ f : 

a! o! a a? d œa a gl go gl! 1 a d EB K 
a Ê a | a? o5 at ah g! 0 a? a o C a 
ve a o ^ ol! a a o6 o 1 at 0-a a ^ x a 
alÜ a5 of of eo? @ 1 of of ao of 0. ae -i a! 
at a? gf d! a 43 of a of of a wf 0° 1 E K 
a! gl ag? o a.a 44 ð a a of a’ 1 0 de. 
X ae gt at EE E 

a” O qx a?” ] & o" o ux a c« uU —— 








Ce ets tiit apu pd" 


P O 
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T" A 67 o? and (b) a +a" c a! in GFQ) 
Fin 


(a) From T 
(b) Again fro 


9 2 3 T 
— o? -- a and so a +a —Qo--a--a-a. 


able 64, 0 = TERE: PE 
m Table 6.4, a! -aób-ra-4landa =a +a" +a and therefore 


a? +03 +a" — o?) cad 14 o) o? o^ a 


— a? o? 12 a. 
L] 
When multiplying two field elements together, factors of al? can be taken out 
d set to unity as a 5 — |. This is equivalent to taking the sum modulo-15 of the 
mnt Given two field elements a’ and a’ in GF (2^) their product is 


ala zz o C )modulo-15 


Table 6.5(b) show the product of elements in GF (2^). 


Example 6.6 , 
Find (a) o?o?, (b) a'?a3, and (c) a'a" at in GF (29). 


(a) sancma 


(b) alat =a! =a ai maia" 
(c) ala" a = oC +12+4)modulo-15 ms a® [] 
To divide two elements in GF (2*) the difference modulo-15 in the exponents IS 

required, and so given a’ and a’, where o^ £0, in GF(2^) then a’ divided by a is 
a — a UJ )modulo-15. 


(oJ 


Table 6.5(b) 


Multiplication in GF(2^) 
M — Me EAE EAE O O 





*  ] Q o! o af Qo a* ^o! a Æ a al a a QU 
e —— M Pn LUE B BE RF NUS del WU a uw 
A : "2 a o o o o^ o o a o Q^ qr a” a" 
d' ui ai a y^ EL SUE GE E Een a wu" gg 
a go a g, = uw ou o? Qo? gl gl? a'ga" | a 
o* o^ x x " a a® Qo? g?9? at a? o? a^ 1 T o 
"ee Am a MES a a alt a? al a*i a al g 
a 6 K a’ a a gi gf au 4? o/s » @ wt of 
aq y o at a él! gU uU uM 4 o af a af a 
a a a ne ma - a^ ag? a | c ve a @& o^ a 
VA ME. a” "a m al? a | a o d o* à a® a’ 
Mp a gl ar a a a^ j ao @ uw a e a^ a. #& 
an € gn ui aT o" 1 ae .o of a* o5 o' a* a 
€ aa i, S Q 1 a o? 3 4 5 6 7 8 9 10 
gue ae um o. : Qo? 4 b 040 o8 o d. 
LUE 4 i n HE ote). oim cu cm wow 
E ul m» 7%, Og en hy c co uw a” m]. 
— C. WW a dud ač og a o a at. a^ a" 





| » 
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Example 6.7 


Find (a) a /a?, (b) a? /a'9, and (c) a/a” in GF(2*). 


int L3 29modulo-15 
(a) à" (y" = os moduk i ql! 
3; 10 3-10 lo-15 8 
(b) ce la = a nodulo-15 |. a 
9 | -9)modulo-15 7 
(C) aja = a TEDPSREANP! YS e A 


Q 
. T nas. i à uA ; 
Each element a! in GF (2°) is its own additive inverse and has a multipli 
; 15-1 l 
inverse given by a =a >. Note that elements that are common to oo 
GF (2°) do not have the same inverse. For example in GF(2^) the inv V) and 


3 . P 2: pK ` = erse 0 2: 
a 2 aU, whereas the inverse of a? in GF(2)) is à? = a, [o is 


Returning now to the polynomial p(x) — x^ x 4- l we have established that 
ofits roots is a belonging to GF(2*), We can now proceed to find the other 3 — b 
using a trial-and-error method in which each field element a! of GF (2^) is tested : 


see if it gives p(a’) = 0. We have already seen that 0 and I are not roots of p(x), and so 
starting with x = a^ we find that 


p(a*) = 0 
pla) =a 
pla?) = 0. 


So far then. three of the roots are a, o? and a‘, recall that the same three field 


elements belonging to GF (2° ) are roots of x^ + x + 1. Another root is required and 
so continuing with the search gives 


p(o^) = 1 
plaf) - a? 
pla’) m a? 
p(o*) — 0 
and o? is therefore the fourth root. The remaining elements need not Uc tested T 
there can be only 4 roots, the reader may wish to verify that taking x =a’, T A » 
a", aP, and a't gives p(x) #0. The roots of the binary equation x*-x4tl-7 
therefore the elements a, a’, af, and o? lying in the field GF(2 ). 
We now take a brief look at GF (2°) generated by 
p(x) = x x 41. 
Setting p(x) = 0 and defining an element a such that p(a) = 0 gives 
o? ai o +] 


31.21 
: pu .- 
which can be used to generate the field GF (25) with 32 elements and M sii AP? 
(see Table 6.6). The other 4 roots of p(x) — e+x7+1= 0areo , ud. 
belonging to GF (2°). ds Ff 
n 


i n fiel 
The fields GF (2°), GF (25), and GF (2°) are just 3 examples of extensio and 


s ees 2» ^? 
can be constructed from the binary field GF(2). Polynomials of degr construct the 


were used to construct GF (2°), GF (25), and GF (2°) respectively. 
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Table 6.6 
The field elements of GF (2) 


a mo* +a 4 o* --à--1 


Q a =a o? tatl 
| a"! =a +ta+] 
a a5 -a-41 
a. a? =a? +a 
nA a” - o? -- a? 
T 3 a? -o* a? 
`A + | x 


Q Y 
a —U TE 
a + a` 
S o HA + L- 
o atta ta 


22 4 2 
Qa =a“ +a°4+1 

23 3 2 
ay =a t+a°+atl 
^ 1 2 
a 5 =a +a +a +a 


Q 4 
25 3 
on = à +a +1 
4 
E 


a 


1 ^ 2 
o? =a ta -- a 4-1 


4 
a? =Q +I 27 
la^ tat] a —a *a-c1 
ns "E. os 28. 4 , 2 
a =a ta ca Qa =a +a ta 
TN 3 4 a? =al 
Q "A +a +a 
4 1 2 to M s a 
al at 4o tat | ca =a ta 


m) a polynomial of degree m is required. In the following sections we 
ties of extension fields and field elements, along with the 
Is that are relevant to the construction of fields. 


- "r^ 
field GF(- ! 
consider some basic proper 
characteristics of polynomia 


64 Primitive field elements 


The nonzero field elements of the Galois fields are generated by taking successive 
multiples of a single element a. Field elements that can generate all the nonzero 
elements of a field are said to be primitive and a is primitive in GF (23), GF (2^), and 
GF(2^). It can be shown that every Galois field has at least one primitive field ele- 
ment. In GF (2°) o? is primitive as can be easily shown. For convenience arbitrary 
field elements are represented by 3. If we let 8-o, then constructing successive 
powers of 3 gives 


B= 

F = (F = at 

8 = (a?! = a 

8 = (a°) = a8 =a (recall that o? = 1 in GF(23)) 
Pa fot} mig! a) 

É = tor’ uultu 








= OR SS ee 
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and so further multiples of 2 will produce existing elements 
ff =A= 
[P = [I = a 
and so torth, Hence o can also generate the nonzero elements of GF(2? 
therefore a primitive field element of GF(2), In fact all the elemen "is 


Wy. em Ww" 3 
and DobcPF(Q Jare primitive and therefore capable of generating th 
elements, 


and j 
ts (other than 


Example 6.8 
Show that a? is a primitive element of GF (2°), | 


Let Ga then 


p c a? = o 


B =a" =a 
p^ n 20 =e 6 


[P = a” = gf 
p° = a"? = a 


B! 2 a? 2 1. 


| 

| 

Hence all 7 nonzero elements have been generated and o? is therefore primitive in | 
"g^ \ 

| 

| 


We can likewise show that o? is primitive in GF (25). However, consider next a’ in 
GF(2*) and let 6 =a", then 


So far this has generated different elements, but the next term gives 


B$ = aœ = I (recall that a! = 1 in GF(2*)) 


erated. 


» 4 
and therefore none of the remaining nonzero elements of GF Q )can be v 
Continuing to take further powers of will only generate 1, o^, o, œ , an c 
example 


i 
Í 
oc 
l 
m 
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Therefore within GF (2") the field element o? is not primitive, There 
ments within GF (2°) that are not primitive, for e 
elements | and a 

Whether or not a field element is primitive can be established by determining th 

order of the element, which for an element @ is defined as the smallest uniter i s. = 
„n such that 8” = L. This should not be confused with the order of a field | which is the 
number of elements within the field. In GF(2?) all the field elements have the sa - 
order 7. For example consider c this has an order of 7 because (a3)! =q*! =] ad 
no other smaller power ofa? gives 1. In GF (2^) however, not all elements ics the 
same order. For example the order of à? is 3, whereas o? has an order of 15. The 
order of an element in GF(2"') divides 2" — | and furthermore determines whether 
or not the element is primitive. In a field GF(2") a nonzero field element /3 is pri- 
mitive if the order of 8 is 2" — I. Within GF(2?) primitive field elements therefore 
have an order of 7 and primitive elements within GF (2^) have an order of 15. 


are other ele- 
xample o? c; 
pie o^ can only generate the 


Example 6.9 " . 
Given that a ^ and a’ are field elements of GF(2*) determine their order, whether 
or not they are primitive and the field elements generated if they are not primitive. 


The smallest power of a" to give unity is 5, as this gives (a^)? = o9? = |. Hence o"? is 


not primitive. The elements generated by a^ are (a°? = a4 =a? (a P =a% =a, 
and (a^)! 2 a? =a”. The next power of a!” gives a® = 1 and therefore a!2 only 
generates 1, c, aô, and a’. 

The field element o has order 15 as (a7)? = a! = 1 and no smaller power of a’ 
gives unity, it is therefore primitive and generates all the field elements of GF (2^). 


O 


6.5 Irreducible and primitive polynomials 


The polynomials x? + x + 1, x* +x + 1, and x? 4- x? + | used to generate GF (2°), 
GF (27), and GF (2°) respectively cannot be factorized. Each polynomial is divisible 
only by itself and 1, such polynomials are referred to as irreducible polynomials. An 
irreducible polynomial having a primitive field element as a root is called a primitive 
polynomial. We have seen that x^ 4- x 4- 1, x* - x - 1 and x? - x? 4 1 have the pri- 
mitive element a as a root and: therefore the polynomials used to generate GF (2°), 
GF(2*), and GF (2°) are primitive. 

For any positive integer mm there is at least one irreducible polynomial of degree m. 
It can be shown that an irreducible polynomial of degree m divides x’ +1 where 
r — 2" — |, and this can be used to establish whether or not a polynomial is irre- 
ducible. Take for example x? + x + 1, this should divide x’ + 1 for it to be irreducible. 
Dividing x" + 1 by x? + x + 1 gives the quotient x^ + x? + x + 1 and zero remainder, 
and therefore x^ + x+ 1 is irreducible. The reader can likewise show that xf +x + 1 

and x^ + x*+ | are irreducible. 

It is not always so easy, however, to establish whether-or-not an irreducible - 
polynomial is primitive. It can be shown that an irreducible polynomial of degree m 
IS primitive if it divides x” + 1 for no r less than 2" — 1. Hence the polynomial must 


ue c 





— 


divide x’ - but not X^ + 1, x74 | and so forth. Consider again x^ +x +1, we 
have seen that it divides x’ + 1 which shows that it is irreducible. To further show 


— i 





—M - -M 
ON 








170 | Galois fields 


that it is primitive we need to show that it does not divide x6 Xl 
(there is no need to consider division into x^ +1, x? tlorx aei x4 
nomial of degree m cannot divide a polynomial of degree x 


ater duse ^ 
dividing by x^ +. + I gives 


xxl 


v-x4l jy Jl ] 
x? + x4 x 
Xxx 
y 4331 
ES A 


resulting in a nonzero remainder. Likewise x^ 4- x -- 1 does not divide x54 | 
x'+ 1 and therefore x -x4lis primitive. in 
The condition given for determining whether an irreducible polynomial Is pri- 
mitive is of limited use. However, a special case arises if 2” — lis. prime, for an 
irreducible polynomial of degree m is primitive if 2" — 1 is prime. Care needs to be 
exercised here, because this special case means that if 2" — 1 is prime then the irre. 
ducible polynomialis primitive, but if 2" — 1 is not prime the polyno Still be— 
primitive. To illustrate this let's consider the polynomials used to generate GF (2°) 
and GF(2"). The field GF (2°) was generated using x? +x+1 which has degree 
m = 3, therefore 2” — | = 7is prime and so x^ + x + 1 is primitive (as we have already 
seen). The polynomial x* + x + 1 used to generate GF (2^) has m=4 and 2" - | =15 
which is not prime. However, the roots of the polynomial are a, a’, af, and o? which 
are primitive elements of GF(2^) and therefore x^ + x + 1 is primitive (recall that an 
irreducible polynomial with a primitive root is primitive). 
Primitive polynomials are a special type of irreducible polynomials. With regard 
to generating a finite field it is the irreducible characteristic of a polynomial that is 
of importance. In order to generate a finite field it is not necessary for a polynomial 
to be primitive, it must however be irreducible. Primitive polynomials are preferred 
because itis casier to generate a field from a primitive polynomial han from one th 
is not primitive. A primitive polynomial has primitive roots and the field can be 
generated by taking successive powers of any primitive root. If an irreducible 
polynomial is not primitive then its roots are not primitive and each root generales | 
only a limited number of field elements. To determine the remaining field elements? | 
primitive element must first be found (recall that every finite field has at least one | 
primitive element). To illustrate this consider the polynomial 
p(x) 2 x! cx! +e 4x41. an 
! ! TR vide x^ +h 
The degree of p(x) is m —4 and so for p(x) to be irreducible it must divi afi 
which indeed it does. Hence p(x) is irreducible and can be used to genera roni 
with 15 nonzero elements. Whether or not the polynomial is primitive m lish | 
determined from its degree because 2” — 1 = 15 is not a prime number. T0 yl. 
whether or not p(x) is primitive we need to determine if it divides o it js nol 
X TL... or x* +1. If p(x) divides into any of these polynomials t 
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be shown that p(x) divides into x? +1 and p(x) is therefore not 


rimiti VC. it nn the field generated by eqn 6.13 we let o be a root of p(x) then 


p ve Tocol 
: IVO, oC 
primit 2 Lo + 1:0 and so 
n 35:3 
4 3 2 
a =œ +a al. 
eding as usual to take successive powers of œ gives: 
Procee - 


4 
a* T a | (Y^ IE (Y 4 | 


o = aa* = ale’ -- o^ +a+1) 2 o* +08 +0? +0 x 1. (6.14) 


Hence o has order 5 and is therefore not primitive and fails to generate the 15 
nonzero elements of the field. To proceed further we need to find a primitive ele- 
ment. None of the elements a’, a’, or a’ are primitive, taking any one of these will 
only generate the existing elements. Instead we need to consider some other element. 
If we let (J = a + 1 we find that 2 is primitive with 2, 67, 2, . .., 8'? giving the 15 
nonzero field elements shown in Table 6.7. We have now constructed two finite 
fields containing 16 clements, the field generated by x^ + x? + x? + x + 1 (Table 6.7) 
and that generated by x^ + x + 1 (Table 6.4). However the two fields are just dif- 
ferent representations of the same field GF(2*), because two finite fields with the 
same number of elements differ only in the way that the elements are labelled 
or ordered. Two finite fields with the same number of elements are said to be 
isomorphic, whilst they may have different representations their mathematical 
structure is the same. 


Table 6.7 
GF (2*) generated by 
px) m x +x? +7 x1 


0 

B — a-1 

b za? 41 

B zoo? al 

=a o? +a 

B —o o^ 

P= 

8! zo? a1 

f. za 1 

ff e 

p"? =o a? 

B 2o) a4 1 
=Q 

B? zo? 

P= Lo 
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6.6 Minimal polynomials 


We have seen that irreducible polynomials anc primitive polynon P 
construct finite 1 " Used 
construction of bi | sed inthe 
Pairs Of com 

then its tdt e 


conjugate | ? | ap | 
likewise occur 1D conjugates, not necessarily in pairs but in gro 
conjugates. Given that / 1S 


8, P, P. P, s.s 8 


where ris the smallest integer such that 87” = B. For example consider the conjugat 
ales 


of a? in GF (2) | 
(o5)! = a 
(o5) = 0 o 
therefore in GF (2) o? has only one conjugate, a’. The conjugates of o in GF(24 
are 
(a7)? = a4 
(o!) = a = a"? 
()8 = a = ol! 
(o7)I6 = gll? =a! 


Pete Se ess 


and therefore a’ has the conjugates ol! a'?, and al^. 


Example 6.10 
/ Determine the conjugates of o? in GF (2°) and in GF (2^). 


— 


In GF (2^) we have: 
(a3)? x 
(o3 = a? 
(a?) au as d 


(a) "E a8 - o? 


i 3 ot 
and therefore the conjugates of o? are af, o? and a^. Whereas in GF) the“ 


jugates of a? are: 
(o?! = a 
(a)? - a? "T a? 
(a)? = a” =a". 
4 
tin GF ) 


Note that the set of conjugates of o? in GF (2^) is different from tha ø 
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Table 6.8 
Conjugate elements in GF (2^) and in GF(2)) 
(a) GF(2") Order (b) GF (2°) Order 
Conjugates 


| | 1 1 
(Y, a’, aa a^ 15 a, a, a? 7 

a” a’, T a^ 5 a. a. aê 7 

a’, a 3 

a’, ae a 15 
aS 


Table 6.8 shows the sets of conjugate elements in GF (2°) and GF (2*) along with 
the order of elements in the same conjugate set. Note that conjugate elements have 
the same order and therefore if an element @ of GF(2") is primitive then its con- 
jugates are also primitive. Recall that the order of an element divides 2” — | and 
therefore if 2" — Lis prime the field elements will have order 2” — 1 and be primitive. 
I( 2" — Lis not prime, then some elements will be nonprimitive with order less than 
y" .. | but there will be at least | primitive element. In GF (2°) 2? — | =7is prime and 
therefore the field elements have order 7 and are primitive. GF (2^) has 2*—1=15 
which is not prime and therefore the field has some nonprimitive elements with order 
less than 15. 

One of the properties of conjugates is that they provide a mechanism for going 
from an extension field to its base field. Consider the pair of complex conjugates 


zz* =p + Jg. 


Taking the product of the two factors (x —z) and (x — z*) likewise gives a real 
expression 


(x — z)(x — z*) = x* — 2px + p> +g. 


In tinite fields sets of conjugate elements perform the same function. Consider a’, 
belonging to GF (2^), and its conjugates a! a a", and a'* Let 


m(x) = (x  a!)(x  a!!)(x + aP)(x +a) 


then 
m(x) = (x? + x(a! +a!!!) + a!8)(x? + x(a? + al^) +a?) 
= (x7 + a®y + a) (x* + o?x + a") | 
=x + 3(a? + a8) e x! (a? +a +a) + x(a +a) ta" 
=x 4341 
Which is a 


as the bbc cibos in the base field GF (2). The polynomial m(x) is referred to 
Smallest jon of o^ o, a, and a'*. It is the binary polynomial of 
Polynomial ofai at has a’, sa, and a!f as roots. Let m(x) denote the minimal 

9! a’, then mx) is defined to be the smallest degree polynomial in GF(2) 


i. 


EE 
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that has à. asa rool, and so 


rm (ar) Q. 


imal pelynomi in (6 
The minimal polynomial nivis also the minimal polynomial Of the eon} i 
and therefore COhjupate, of 


X 


mes(V) oma! mialy) = nmia(x) m xS ae! kl 


where arah niit v). nnt LV), and maloo are the minimal polynomials of’ ql 
and a’? respectively, l Sole al n 
To determine the minimal polynomial mix) of an element 8, a factor (r4 ge 
required for each conjugate 37 of 3, Chis ensures that the conjugate 3° is Ms 
mix). The minimal polynomial is then given by the product ofall such 


)is 
* 3 
O" is a root of 
factors, so that 


, 2. i tal 
mix = (t Ba t FY 8*) (e a") (6.16 
where ris the smallest integer such that F< gd. In GF(2") the conjugates of a area? 
at, a and the minimal polynomial of a is therefore 


nuQ) = (x+ ally Fa^)(x4 a*)(x 4 a`) 
(x* + a?x 4 a*)(x? + o^x + a) 


= Fx l. 
The minimal polynomials of a^, at. and a? are all equal to m(x) 
m(x) = m(x) = m(x) = mi(x) = x* txt. 


= ; . (s te ABO 4 
Table 6.9 gives the minimal polynomials of field elements in GF(2') and GFQ)). 


Table 6.9 " 
Minimal polynomials in GF(2°) and GF) 
Field elements Minimal polynomials 
(a) GF(2) 
0 x 
| x1 
cx, a? o* x Tx 1 
a, a`, a? xy" xt t+ 
(b GF (24) 
Q X 
1 x41 
a, aò, a’, aè x* + xt 
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11 | is 
— dali polynomial of o? in GF (255. 
Fin 
"s conjugates afar are (a°)? =a and (a°) = oS. The minimal polynomial of o? is 
therefore 


ms(x) = (x + o?)(x + a’) (x 4 af) 

(x^ + o^x + o)(x + of) 

= pray a?) + x(a® + o) 4. o7 
=i x, e p 


This is also the minimal polynomial of o? and af. 


[] 


7 Solution of equations in GF (2*) and GF (2°) 





We have seen that addition and multiplication of field elements can be carried out 


ilna Tin finite fields though are not restricted to just addition and mul- 
"aie ield elements, for much of the mathematics that can be performed in 
aca: complex fields can also be performed in finite fields. Indeed It is often 
má "is out a mathematical operation in a finite field than in the real Or 
theres Helds due to the finite number of elements. Here we consider various 

tistics of Galois fields, with particular reference to the solution of equations 
Within the fields. 


Consider first the linear equation 
aex+a'l =0 


defined in GF (2^). This differs from the equations previously considered in that its 
Coefficients belong to an extension field. In the previous sections the coefficients of 
“quations were real or binary, only the roots of equations were in extension fields. 
Nevertheless there is no reason why we cannot construct an equation whose coef- 
iclents belong to an extension field. We can easily solve the above equation, taking 
* over to the right-hand side gives a?x =a'! and dividing through by a gives 
X= q! a —— 
= r . "hl m . 4. 
Every element in the field GF (2") has a square root witam d ut. Consider «am 
F(2^, ; 4 a? Likewise in GF (Z`) the square root of a? is o. . 
(2), its Square root is ya =a’. L1 . . à; 
| 5 in GF (2^) is not so obvious. To deal with this we 
?Wever the square root of o? in G cosh so sisti 
Multiply a5 by a? and then take the square roo", 
; $515) ee fa es aiv. 
ya = v (a a 


a? is 


G 


t of 
Note, however, that in GF (2°) the square roe 


12 _ o6 
Yo! = s(a) = Ve" =o 


_ iili. | 1 





BE 


Hence the square root of o? in GF (2?) differs from its square root in GF 4 
Next consider the roots of the quadratic equation (2^), 
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F, ^ 
x^ t+ a" x + a = 0 


defined over GF (2°). Here again we have an equation whose coefficients bel 

an extension field. We can factorize the above equation by using the « e. to 
approach of establishing two terms whose sum and product give the , dard 
coefficients. If 8, and 3 are the required roots then “quired 


(x+ G,)(x+ G) =0 
and expanding this gives 
x^ +x(3; + 83) + Bi — 0 
and therefore we need to find the field elements 3, and 2, that satisfy 


34+ Q = a"? 


813; = a”. 
Referring to Table 6.5 we see that the field elements o? and a’ meet this requirement, 
since 
aa’ =a” 


and therefore 


ó« 7 7 ^ 2. 9 — 
(x a^)(x- a )—x aere =0 


so giving a^ and a as the roots. The solution of equations in a finite field can i 
achieved by a trial-and-error method in which field elements are systematically 
tested to see if they are roots. Such an approach of searching for roots is referred to 
as a Chien search. For example consider the roots of p(x) =L ox PEAT 

over GF (2°). Starting with x = 0 gives 


p(0) =a | 
p(l)- a* ' 
pla) =a" | 
pla?) 2 0 | 


; the othe! 
and so x =a" is one of the roots.Continuing with the search shows — "s 
roots area and aê. Note that within an extension field polynomials can 2 " 
not have roots within the field but lie within some other field. Consider 


uec ON ROU hin at nns . 


" * > ? & 0 
P(x) =x +a x+ a! 


vet 
. eeducibk 9 
in GF(25). A search fails to find any roots and therefore p(x) 38 irred 
GF(2^). 
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e field GF (2") is that the square of a series of terms added 


erty of th de: 
f the individual terms squared. Consider x, + x; squared 


ual to sum O 
(xi + x2)" = x T X1X2 + X2X| + x3 


useful PT rop 


rogether is ed 


= 2x4x3 = 0 we see that 


X? + X2X1 
because X] 
and (xi -- x2)! = xl + x2. 
gquarin£ this again gives 
212 2 2 4 4 
(Gi x2 Y. = {04 + x5)}° = x} + x} 


(x; + x2)4 zx x + i5. 
This can be extended to all powers 2', where i is a positive integer, of (x, + x5) so 
giving | | | 
(xi 4x1 2x] +25. (6.17) 
For example in GF( 2^) 
(x +a’)® = x8 + (o?) 
=x +a" 
=x +a". 
Care must be taken not to incorrectly apply eqn 6.17, for instance 


(xj + xj? z (xf + x$). Equation 6.17 can, though, still be used to expand such an 
expression 


(xi + x3)? = (xy + x2) Ga + x) 
= (xf x6 + x) 
= x xox a XT +x. 


Example 6.12 
Expand (a) (x + o5? in GF (2°) and (b) (x 4- œ) (x +a’) in GF (24). 


(a) In GF (2°) we have (x -- o^ 2 xi o8 — x? o. 
(b) In GF(2*) 
(x + o?) (x + a!) = (x + æ) (x + o? )(x +a) 
= (x* +a (x7 + al? x4 a") 


= x° +a r 4 x" + ax + ax + al". [1 

Equ 
GROM the 6.17 can be applied to a series of r terms, given x; -- x2--::--- x, in 
(X1 +x +.. TE = xd pex (6.18) 


Where 
! I5 a positive į integer. 


> 
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Matrices and determinants of field element 
the same algebraic rules as when constru 
obviously though using the additive and mul 


Scan be construct | 
cted With rea] Or 5 dre Si 


tiplicatiy 
which the field elements exist. Over a field GF(2" i of the finite fi n 
rix With 
Qi} d) ... |, 
do “al a22 ... dq, 
a, ap « s Arn 


can be defined where r and n are positive integers, and where a 


with /—1,2,...,randj— 1,2,...,n. Consider th 3 : y are field eleme 
uie by 3 matrix defined in GEO 
o? a wi : 
41—-|0 al a | 
a! o? ] | 
The determinant of A, is 
10 
Qu 0 a 0 10 
det A; = o? +a . +a 
a a’ ] a’ o 




















= a (a'* + at) + a(0 +a) + a3(0 +a”) 

= o*o* + aa? + aBa? = at o? 4 1 2 of. 
Note that det 4; isa field element of GF(2*). As det A, is nonzero we can determine 
the inverse of A,. The inverse A^! of a square matrix A is given by adj A/det A where 


adj A is the adjoint of A and det A £0. The adjoint of a matrix is the transpose of the 
matrix formed from the cofactors of 4 and so 


mb 


Ay; An e An 

Anr 42 ... Ay 
adj A = à; 

Aj, A», es Ap 


cluding the row and 
hed to the cofactor, 
nverse 0 ] 


where the cofactor A; is the determinant constructed by ex 
column that ay lies in. A plus or minus sign is normally attac d 
however as the base field is GF(2) there is no need for this. To find t 

we first determine the cofactors 


10 4 2 
Q 3  ,10 zu 
An =| S, |- a! +00? =a tTa 


13 
— al 4 oPo? 2 a4 o70 





4a =| 





—_— i 
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io evaluate the other 7 cofactors we get 


uid MI 
"Aib ine a 0 l 
adi dac Ay An An] = a’ A 

dn dn An n? al gi 


r verse el 4), I^ ther fore 
| Ww ’ l 
4, — adi Ay / det Ay 


a 0 | 
(ala a a` 
a at a" 
a? /a* 0 L/a* 
a/a a/a aa 


^ ^ 
v/a atla a?/a' 


which gives 


Ar m |a’ a | 
a4 a o 
1 0 0 
he reader can check that 44;'=|0 1 OJ HF 
0 0 | 


Example 6.143 
Determine the inverse of the matrix 


in GF(2) and GF(2%). 

à y^ L| x = n 
In CEO ) the determinant of A is 
ao o? 


8 
=a o l =a o) z I. 


det A = 








As det 4+ 0 the inverse therefore exists. The cofactors of A are A =a, An =l, 
An = a^ and 45, =a" and so the adjoint of A is 


An Ar a a 
adj A = it 
pe "i | | a 
The inverse of A is therefore 


d 
A^! = (adj A)/det A = t M 


i. 





i | 
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The determinant of A is 


det 4 — o? 














o? (a? + al) + ala? + ut EN 


a5 +a -- a6 = 9? 


The adjoint of A is 
adj A == a o!!! 6 


and using A7 ' — adj A/det A gives 


8 14 14 


Qo a'* a 
A! = |a al^ a 
a a o^ 


Multiplying Ax — c by A^! gives x= A^!c and therefore 


P o$ o^ ani fa 
alela al a a 
X3 aw a af l 


which gives x, =a, x4 — o, and x3— a*. 


Problems 


6.1 Given that a is a field element of GF (2°) evaluate 
(a) (02a ^? + 1) (o* + a) 
(b) V (aaa? + a). 


Repeat when a is an element of GF(2^). 
6.2 Determine whethei the polynomials 
p(x) =x +x x+] 
p(x) =x" * x41 
p(x) 2 x! +x +1 


over GF(2) are (a) irreducible and (b) primitive. 





o?  q6 
o4 a 
l(a? + a?) 








| 





6.0 


6.7 
6N 


6,9 


6.10 


6.11 


i 
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‘ 7 
ynomial p(x) =x 4 x4] over GE), construct the field 
find the roots of p(x) =90, 


iven the pol ’ 

and therefore 
* op», 3 $ H TY à; » 

that the field elements of GF(2') are primitive (except for 0 and |), 

2 7 p T F P / , dg 

whether the elements a^ and a? in GF (2^) are primitive, 


Given 
GF(Q) 
Show | 
Determine "db | | 
Given that Gis à root ot the irreducible polynomial p(x) = x j v^ 4 | over 
GF). construct. the field GP) using p(x). Note that the field GP(2°) 
constructed. using V FN + | is the same as that constructed using 
aat LL they differ only in the way in which elements are labelled, 
Determine the conjugate sets for the field elements of GF(2?) (see Table 6,6). 
Show that the minimal polynomials of a and a? in GF (2^) are 


i 
mi(x) =x + x" + I 
5 
my(x) =x? +x" + xxl 
respectively. 
| 3, 8.2 1. : = 
Kind the roots of x! + a v^ c a ^x 4+a=0 defined over GF (2°). 


Find the determinant of the matrix 


over GF(2") and GF(2?). 


Determine the inverse of the matrix 


. 

alt 0 a 
A = | a a 
? 
a^ al aè 
y». MP NI d A i. 

over GF(2^) and GF (2%), 

Solve the linear equations 
XT ay =a? 


- 2 
Q xd ayz a? 


* r ` ` ; ^ 4 ‘ i | 
defined over G F(2^). Show that the equations do not have a unique solution 
when defined over G F(2°) 


Solve the linear equations 


0 
ny ap aty +az=0’ 


4 ^ 
oO X4 a'y Rima! 
` 
QAN + aty +a =a 


defined over G F(2)). Repeat over GF(2?). 





Bose-Chaudhuri-Hocquenghem codes 


SS es eas 
S a ES 


Having considered the properties of finite fields W 
move on, from cyclic codes, to the next level of CO 
Hocquenghem (BCH) codes. Cyclic codes were int 
their cyclic property. Later we saw that one of th Cyclic coa, of 
codewords have their generator polynomial as a factor and the roots x IS that 
generator polynomial are therefore ‘roots of the codewords. Here We first ; |. 
cyclic codes in terms of roots in an extension field and then WE See that by ae 
well-defined set of roots we can construct BCH codes. The BCH codes mins à 
cyclic codes, they are a powerful class of multiple-error correcting codes with wan 
understood mathematical properties. Binary and nonbinary BCH codes exist d 
in particular the Reed-Solomon codes are a popular nonbinary class of BCH. 
which find many applications. BCH codes are generall 


y considered to be the Most 
important class of codes; a study of error-control codes is incomplete Without 
considering BCH codes. 


€ properties of 


7.1 Cyclic codes revisited 


We have seen that 


a codeword polynomial c(x) of an (n, k) cyclic code can always be 
Written as 


c(x) = f(x)g(x) (7.1) 


f(x) is the information polynomial (x), whilst fora 
systematic code f(x) is the quotient q(x) obtained by dividing i(x)x”™ by g(x). From 


eqn 7.1, itis clear that any root of g(x), is also a root of c(x), for if we let 8 bea roo! 
of g(x), then 2(3) — 0 and 


where for a nonsystematic code 


(3) = f(8)g(8) = 0. 


Hence in a cyclic code the roots 


of the generator polynomial g(x) are also roots of 
the codew 


ord polynomials. Consider the codeword polynomial 
G(x) =x" --x* et 
ots of 
belonging to the (7,4) cyclic code generated by g(x) — x? -- x 4-1. The 3 ro 


. 3) Substituting 
~ +x + T are the field elements o, a”, and af belonging to GF(2’). Su 
X= into c(x) gives 


c(a) 2 o? +a27+a4+1=0 
? then 
r ` . = a2 t 
Where the calculations are carried out in GF(2°). Likewise if we let x 


c(o^) =a! + o* 4074+1=0 








— 





pa a ÀÀ u—— 0 


A SL! 
on ——M sham I an e 

aita — rm ]Ó 

í——————— 
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i 
aid s c t! wives 
4 
(a) a ahate Iel, 
he rember WAY wish tis verify tuat any af the other codeword polynomials of the 
Toit Bik, nt : Whal iy" na Peseta, 


a ele alie EY 


: Nest congue tel ihe (14, 11) eyelie vede with the generated polynomial u( x) — 


"ut V | ET 


e(v) = A" 4 oe at oh at dk ee | 


jo 5 — 
vue ed Hceedewnnid polynomials, Phe rete og OD are o al" ot anda" in GEOS). 
and aubistitutitui these (abe rli) given 


c(i) "TE a” | TÀ a^ Fed l0 
O(a?) e a ce? qa at | 0 


} ' 
ete) e t du Ti fe e 4 on d 120 


! ae gy de ev? b ng pb nm ESE 


etat = (f 
anilan, vet agat, the roota of the generator polynomial arë roots of the codeword 
polynomial 

the polynomial v dE and SI ps d E serve 2 Functions, they are generator 
polynomials of evelie coder wid, because they are irreducible, they are used to 
Conatroet Anite Held A generator polynomial need not be irreducible in which case 
can mot be used to construct a finite Held, For example, the generator polynomial 
tor the (15, Develie eode 


RN) = v aea! dex ae at d d 
vän be Facterized as 
p(x) e (NT 4 x Do WERE PS 


amd is therefore reducible in Ge) and cannot be used to construct a Finite field. The 
8 roots ob no are field elements in GAON with minimal polynomials x! 4- x 4 Lor 
i \ ) (gi 

VON b NT bs d E buta cannot be used to construct G7(2^). 


Nhe generator polynomials v px 4 E and vp avd E ean be expressed as 
vov be (do) d aS 4 a) 
and 
vu b= (vb alr 4 a*)(x 4 a*)(x 4 at) 


and we think of each generator polynomial as being specified by a chosen set of 
Held elements Sov ox bis specified by o, a? anda in GFQ"), and x" 4 x 4g by 
"0 o, and a" in GF. Note that o, a’, and a form a conjugate set in GAY 
With minimal polynomial x* pack h and that in GEN a, o^, af, and a* form 
^ Conjugate set with minimal polynomial x^ x 4-1 (see Tables 6.8 and 6.9). 


i 
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To construct a generator polynomial g(x) from an arbitra 
Bis Bass see 8, we need to find the polynomial of least degree thar po! r fielq 
as 
l 


its roots. The polynomial lemen, 
ca 

8(x) = (x B1)(x +B)... (x + 5,) 
satisfies this requirement, but may not bea binary polynomia 03 


3,=a and 3i— a? in GF(2?) gives (X) — (x - a)(x 4. & 
has coefficients in GF(2°). Replacing each factor (x+ 
polynomial of 3;, gives 


2 Ul exa 
2)_ > Mple ta). 


Bi) by máx). the Which 
Ma 


g(x) = mi (x)m(x) ->m (x) 


mu | "- (73) 
which is now a binary polynomial with roots Bi, B». .... B,. ]f any of 


By), 8», .... B, are conjugates of each other then eqn 7.3 will A multi Clement. 
of the conjugates' minimal polynomial. Taking the Leas; Common M e; factors 
of g(x) will exclude all such common multiples and give ‘ “ple (LCM) 


g(x) = LCM[m (x), m; (X),..., m,(x)] (14 


as the binary polynomial of least degree with roots Ps B... : B. In GF(" 
product of 2 or more minimal polynomials divides x4-! +1, where a a. 
therefore g(x) as given by eqn 7.4 is a generator polynomial for a cyclic code. i 
Let's reconsider the (7, 4) code whose generator polynomial x? + x 4 | has roo 
a,o^, and atin GF eal According to eqn 7.4 the generator polynomial specified hy 
a, Q^, and af is l 


&(x) = LCM [m (x), m(x), ma(x)] 


where m(x), m(x), and m4(x) are the minimal polynomials of o, o? and o 
respectively. However in GF (2 ) m(x) = m(x) = ma(x) — x? -- x 4- 1 and therefore 
we get 

g(x) = LCM[m (x), m (x), mi (x)) = mi (x) = x? +x41 


as required. 


7.2 Definition and construction of binary BCH codes 


We have seen how to construct a generator polynomial, of a cyclic code, with an ! 
arbitrary set of field elements as its roots. The BCH codes are a subset of cyclic codes 
whose generator polynomials have roots carefully specified so as to give good a 
correcting capability. A r-error-correcting cyclic code with generator polynomia 

g(x) is a binary BCH code if and only if g(x) is the least-degree polynomial over 
GF(2) that has 


B, B, p, . . po 
"A ‘on of 


as roots, where B is an element of GF(2”). It can be shown that with tis mentPiS ; 
roots the resulting code is capable of correcting : errors. If the field eet | 


j 


"MET a AMETS T 


Definition and construction of binary BCH codes | 187 
primitive then the codes are known as primitive BCH codes and have a blocklength 
ofn= 2” - 1. The BCH codes considered here are primitive, unless stated otherwise 
with er: i 





as the 2t consecutive roots. Using eqn 7.4 we can see therefore that th 


: -——t e generator 
polynomial g(x) of a t-error-correcting binary BCH code is given by | 


g(x) = LCM |m; (x), m(x), m(x), . . ., mu (x)] (7.5) 


where mx) is the minimal polynomial of a‘ and a is an element of GF(2"). As the 
minimal polynomial of an even power of a field element is always equal to the 


minimal polynomial of some odd and lower power of the element, the minimal 
polynomials with even i can be omitted from eqn 7.5 and therefore 


g(x) = LCM [mi(x), m(x), ms(x),. .. mara (x)]. (7.6) 


The blocklength of a primitive BCH code constructed over GF(2") is n — 2" — 1. 
BCH codes are cyclic codes and the degree r of the generator polynomial of an (n, k) 
cyclic code is n — k. Hence the information length k of a BCH code is k = 2"— 1 — r. 

As an example let's construct a double-error-correcting BCH code over GF(2?). 
Here t = 2 and taking 6 = o, where a is a primitive element of GF(2"), gives 


g(x) = LCM|m (x), m(x), m3(x), m4(x)] 


where mi(x), m(x), 3(x) and ma(x) are the minimal polynomials of a, o^, o^, and 
a’ respectively. In GF (2^) the minimal polynomials 


and so m(x) and ma(x) can be excluded from g(x), therefore giving 


g(x) = m(x)m3(x) 

= (x*-x-4 1)(x4 + x? dax xl) 

= xx! xS x44 1. 
As o is a primitive element of GF (2^), the blocklength of the constructed code is 
n=2"—1=15. The degree of g(x) is r=8 and the information length is k= 
n — r 2 7. We have therefore constructed the double-error-correcting (15, 7) BCH 
code with g(x) 9 x8 +x +x - x 1. 1 

A single-error-correcting code with the same blocklength can be constructed over 

the same field. Let «= 1 then 


g(x) = LCM [m (x), m»(x)]. 
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Over GF(2*) the minimal polynomial m(x) = my(x) = 


—— 


4 
X 3 " 
g(x) 2 m(x) = x^ --x | 


The blocklength is 1 — 2" —1— 15 and the information |e 
because the degree of g(x) is r —4. This is therefore the « 
(15, 11) BCH code with g(x) — x^ 4- x 4- 1. 


ngth is kana, 
ngle-error-corey 
b 


Example 7.1 


Construct a triple-error-correcting BCH code with blocklength n = 31 over ( 
i er GRQ’ 
Let / = 3 and a be a primitive element of GF U^ The generator polynomial k i 
is 

g(x) = LCM[|m; (x), m(x), m(x), ma (x), ms(x), ms(x)]. 


In GF(2°) 


3 
< 
| 
= 
a. 
x 
A 
+ 
ot 
dla 
be 
J- 


and g(x) therefore reduces to 


g(x) = mi(x)ms(x)ms(x) 
= (x9 pE AI + x* x5 xh 1) 08 E x* x x) 
e xl5. E pal 9 4. x8. x1 x an x^ x I. 


The blocklength and information length are n= 2-]- 3l and k —31 — - 
respectively. This is therefore the (31, 16) triple-error-correcting binary BCH code. 


« à x g - t+l1. 
A t-error-correcting BCH code has a guaranteed minimum distance of d=21+. 


However the minimum distance din of the code may be greater | than d, ine 
giving the code an error-control capability greater than that. designed. Assit 
minimum distance d= 21 + 1 is known as the designed distance of the code, 
any BCH code dj, > d. ore 

.BCH codes are cyclic and linear, and so once a code's generator polynonit ty 
is constructed, encoding can be carried out in the usual manner usak a 
generator matrix Gconstructed from g(x). It is at the decoding stage tha BS as tdi 
specific to BCH codes are used. | 


7.3 Error syndromes in finite fields | 
At the decoding stage of an error-correcting code, decisions are exords, whethe 


of error syndromes that depend on the presence of errors. in cyclic 
represented by vectors in linear codes or polynomials 7 
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tructed so as to give a zero contribution to the error syndromes. In a linear code, 
a rds c satisfy cH! =0 and the error syndrome of a word v to be decoded Is 
— (where H is the parity-check matrix). In cyclic codes, codeword polynomials 
: i satisfy Rale) = 0 and the error syndrome ofa polynomial v(x) to be decoded 
pe -R ool: With BCH codes, error syndromes are also defined, this time 
ín are field elements in an extension field and again codewords do not contribute 


to the error syndromes. | | . : o 
à f-error-correcting BCH code with o, o^,...,o' as the roots of its 
Consider a 


generator polynomial g(x). The roots of g(x) are also the roots of the codeword 
polynomials c(x), and therefore 


c(a') 20 (7.7) 
for i— 1,2,..., 2t. Equation 7.7 provides a means for testing whether a polynomial 


v(x) is a codeword of a BCH code. A polynomial v(x) is a codeword if and only if 


mom "A aœ” are roots of v(x). Now consider a codeword c(x) which incurs an 


error pattern e(x), so giving 
v(x) = c(x) + e(x) 
as the polynomial to be decoded. Substituting x = a gives 
v(a) = c(a) + e(a). 
However, from eqn 7.7, c(a) = 0 and so 
v(a) = e(a). 


Hence v(x) evaluated at x =a depends solely on the error pattern e(x) and can 
therefore be used as an error syndrome of v(x). Evaluating v(x) at any of the field 
elements a’ gives 


v(a ) = c(o* ) + e(o! 


which again reduces to 


for i— 1,2,...,21. Hence from v(x) we can obtain 2t error syndromes and we define 
the ith error syndrome of v(x) as 


Sj; = v(a' ) (7.8) 


where i — ], Baasa ui. 

The error syndromes S,, S>,..., S5, are elements of the field GF(2") containing a. 
Table 7.1 gives a comparison of syndrome definitions in linear, cyclic and BCH 
codes, along with the condition that codewords satisfy. 

If v(x) is error free then v(x) = c(x) and 
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Table 7.1 
Error syndromes in linear, cyclic, and BCH codes 
Linear Cyclic BCH 
Codewords cH! = : Read] - 0 elo) iud 
Error syndromes — vH s(x) = Rek) £s Kar 





tor all 2t error syndromes. For example, consider the codeword 
fo 9 & 
x)= x* XP x exta xa] 


belonging to double-error-correcting (15, 7) BCH code. Let v(x) — e(x) and " 
then over GF(2^) we get 


2, 


Si = va) =a’ +0° a of o4 129 
r iy 1 2 

S; = (a) = a’ +a! "+08 +0741 =9 
! >, 3 ; 

$1 = vía) 2a? 4 a +l+a +æ] = 0 


Ss = v(a*) 2 a8 - o? ta tata lIn, 


+ a! 


lt :(x) contains errors, then some or all of the error syndromes will be nonzero 
i 7 4 . , 
Introducing an error, say e(x)= x + x*, to c(x) gives 
v(x} = c(x) - e(x) = x 4 x 4x6 +x% +x + | 
and recalculating the error syndromes now gives 


Si = va) = 0° -- a! +0° 4- o apr! 


Sp = v(a’) = à? -- a!^ 4. 912 4919 4 2 4. | =a 
S; = v(a") 2 a" 40° +03 4140741 = 04 


v(a?) =a°+ aU 4. o? t o? +a’ 4122", 


i 
| 


If the number of errors does not exceed the error-correction limit of a BCH code 
then, as we shall see, the error pattern e(x) can be determined from $}, E m 

Calculating error syndromes in a finite field can be simplified by using eqn 6.18, 
which shows that for x), x5,..., x, in GF(2") we can write 


tte tr a(t te tx,), 
For example, here the error syndrome So, given above can be expressed as 
S» = (a) + (o2)! +R + (a?)5 4+? +1 
= (o?) (a^ + (a®)? + (a5)? + (a)? + I 
= (a +a - af o3 +04 Lj 
and as 


Si =a’ pa +af ta tal 





» 
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we see therefore that 


9 - 


Likewise Ss = S5 and clearly the error syndrome Sy is given by 


3a = 5. (7.9) 


When calculating error syndromes we therefore need only to evaluate S, = via’) for 
odd values of i and then use Sx = S; to obtain the error syndromes for even values 
of i, However, note that this-onlv applies to binary codes, eqn 7.9 cannot be used 
«o determine the error syndromes of nonbinary codes. 

The decoder has no a priori knowledge of the error pattern, the only information 
that the decoder has is the polynomial v(x) (or word v) and the error syndromes that 
++ calculates from v(x). An error pattern with z errors can be represented as 


e(x) = x NP aeo s (7.10) 
where the error positions pi. pa. . -Pa give the locations of the errors in the cor- 
responding error vector e. For example in an 8-bit word the 3-bit error pattern e — 
(00101001) gives pı = 5, p2=3. p3=0 and so 

e(xX) 2 x 4 I unm V r1. 
A codeword c(x) incurring u errors gives 
v(x) = c(x) + e(x) = e(x) + QU P + M) 


asthe word to be decoded. The decoder for a t-error correcting code evaluates v(x) at 
: It NO QM a^ to obtain the error syndromes 


$; = r(a) 2 c(a) + e(a) =a" c aP 4 +0” 
S- An ría”) = c(a7) + e(a-) = av + o ewes S qa 


S: = v(a?) = cla?) + e(a!) =a +a 4. +07 (7.11) 


=f HW». : ; Up: Up, 
e  c(e") E C a7 tart +0 P». 


For clarity the right-hand side of eqn 7.11 is usually expressed in terms of error- 
location numbers X; where 


Note that the exponents of the error-location numbers give the error positions. The 
. n 
error-location numbers YX,, Y». .... X, are nonzero field elements in GF(2") and 


Provide a convenient representation of the unknown error positions pi. P2. - Pie 
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Equation 7.1] can now be expressed as 


S, — Xi X2 4 Xa t oo X, 
: "2 7A 7 2 
‘So Stee X, -+ X5 + A 3 -+ V RT Es X, 


Sy= X X? XS ooo X (113 


- p wv D P 
321 c X r +. x; + X -+ T S -+ yn, 


Equations 7.12 contain u unknown yariables X1, X5, X3,..., Xp and 2t known terms 
$585.85, o S>, and are referred to as the syndrome equations. Earlier we saw that 
S5, = S? and therefore of the 2 syndrome equations only ¢ equations are indepen. 
dent. Hence this is a set of ¢ simultaneous equations with j; unknowns, and if p<; 
then a unique solution exists. In other words, if the number of errors falls within the 
error-correction capability of the code, then the error-location numbers can be 
determined. The exponents of the error-location numbers are then taken as the error 
positions. However, there is a problem in determining the solutions of eqns 7.12. The 
syndrome equations are nonlinear and therefore cannot be solved using standard 
linear techniques such as matrix inversion. Instead, indirect methods are used 
involving the transformation of the syndrome equations into a form that can be 
readily solved. The solution of the syndrome equations lies at the heart of the 
decoding of BCH codes, any method that can solve the syndrome equations can be 
considered to be a decoding technique for the BCH codes. The most important 
method for decoding BCH codes is the Peterson—Gorenstein—Zierler decoder which 
is capable of dealing with multiple errors. However we first examine the simpler 
problems of decoding .single-error-correcting and double-error-correcting BCH 
codes without the use of the Peterson-Gorenstein-Zierler decoder. 


7.4 Decoding SEC and DEC binary. BCH codes 
Decoding a single-error-correcting (SEC) BCH code is quite straightforward. Fora 
single-error-correcting code t= 1 and we assume that a single error (i.e. the max" 


mum number of correctable errors) has occurred so that p=1. Substituting 
f= u= | into the syndrome equations (eqns 7.12) gives 


$i = Xi (7.13) 
$5 2: XE 


and therefore the error-location number is directly given by 


Xj = Si. 
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le, cons 
e that c(x 


v(x) = e(x) + e(x) =x +x, 


E a b T - - ting code const " CN raa 
4) code 1$ à single-error-correc onstructed over GPF(^) ar 
re evaluated over GF (2°), In GF(2/) ) and so the 


ndromes a 


The (7; 
error SY 


Si = v(a) = of +a+l|l= o? 


rome equations, given by eqns 7,15, we get X, = w’, The exponents 
ion numbers give the error positions in the error pattern and 
as the decoder's estimate of the error pattern. The 


he synd 
locat 
o? gives e(x) =X 
rd is 


and from t 
of the error- 
therefore X, 
resulting codewo 


c(x) = v(x) + el(x) = xy -xv4x4l 


now is correct. Decoding will always be correct providing 2 or more 
If the error syndromes are Zero, then the decoder assumes that 
the correct codeword. Note that a syndrome table has not been 
4 table for addition in GF( 2’), Note also that 5; is not 
n the decoding process and therefore need not be computed. 

t decoding double-error-correcting (DEC) BCH codes, We again 
f the maximum number of correctable errors, so that 


which We k 
errors do not occur. 
the received word is 
used, but we have used 
required j 

Consider nex 
e the occurrence O 


assum 
u=t=2 and the syndrome equations (eqns 7.12) reduce to 
T. (7.14) 
$4 = y T x. 


uations, involving Sz and 54 respectively, are 


The second and fourth of these eq 
d therefore solutions for X, and X; can be 


dependent on the first equation an 
obtained from 

$, =X, + X 

$4 = i + X 
as these are two independent equations with two unknowns. The two equations are 


nonlinear and cannot be solved using matrix inversion, instead we proceed as fol- 


lows. Consider (X + X. A 
(Xi + X = Qn + Xa) 08 + X2) 
= (X? 4 X)06 +X) 
= xX $ ys +X XXI + X2). 
Substituting X, + Y; = Sı and X} + X, = $ into the above gives 


s = Sy + 8X 
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and replacing V» by Vy X, + SN, gives 


Rearranging and dividing through by S, gives the qi 
— S eu rx EES iadratie equati 
| uation 








tiera Oth " 
X 4 AN; +. an SAREA) 
Si > 
(7.13) 
and the solution of this gives X4, with the other solution e giving X. If 
Y. + S,, instead of Y; = X, + S. then We let Ya 
CX t ^ 
A. T . (a _ F Sy) 
XS H M E 13 Ld. Il = Q 
T (7.16) 
is Obtained or ofeqn 7.15 and again the two roots give X, and Xs. Whe 
ean 7.13 or 7.16 is used to determine Y, and Y ether 


2 IS quite arbitrary and We can 
therefore write 


1 
v Cir di (Si + Sy) 
| — CH ü (7.17) 


Where Y; and Y. are the two roots. The roots of eqn 7.17 can be obtained by using a 
Chien — that is by systematically testing to see if field elements satisfy the 


equation, or by establishing the two factors (see Section 6.7). As an example, we 
consider the codeword 


Bow N. e R ,: 
c(x) 2 x x x XP Bx 


belonging to the double-error-correcting (15,7) BCH code. Introducing an error 
gue m 
pattern, say e(x) = x'® x^ gives 


v(x) = xl p xl? a x8 x? a 
and over GF(27) the error syndromes S, and S; are 
Sı = va) = a” +a" ^ro +a’ + a $ o? =a 
S; = v(a*) -a'+l+a’+a° +a? +a’ = al, 
Evaluating (Sj + S3)/Sı gives 


(S+S) (a? +a") _ oO _ 
S| i a? at 


=—— -— s 4 > 
and substituting this into eqn 7.17, along with S, =a’, gives 
x -- a*x 4- a? — 0. 


The two roots of this quadratic equation give the required erro re 
Let p(x) 2 x? - ax - a", then using a Chien search we syste 


* 
y 
d 
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| nonzero field elements of GF (2^) to see if they are roots of p(x). Starting with x= | 
| p(1) = a? 
p(a) =a 
pla) =0 
p(a’) = a? 


So far a” is one solution. We could continue searching for the second root but it is 
easier to use the first expression in eqns 7.14, namely S = X, + X», which gives 


X= Si +X o! o? 2 9? 


as the other solution. The reader can verify that p(a'®)=0. The error-location 
numbers are therefore X, = o and X2 =a", the exponents of the field elements X, 
and X; correspond to the errors x^ and x respectively. We have therefore correctly 
determined the error polynomial e(x) = x + x^ present in v(x). 

[n the event of a single error occurring there will be only one nonzero error- 
location number and so X, = Sj, X; — 0, S3 = X1 = S? and eqn 7.17 reduces to 


X - $1 — 0. 


The error-location number is therefore directly given by S; (i.e. it is the same as 
decoding a single-error-correcting code). For example consider again the (15, 7) 
double-error-correcting BCH code with codeword c(x)=x!! 4 x +x + x64 
x? 4- x’, but this time incurring the single error e(x) = x*. Here v(x) 2 x!! 4 Bayly 
x°4 x44 x? + x? giving the error syndromes 


Sı = v(a) = o* 


$3 = (a) = a? 
over GF(2"). Evaluating (S? + $3)/5, gives 
(Si +S) _ (a4)? +a? _ a? +4 9"? e 
Si i ad a$ 
The constant term in eqn 7.17 is therefore 0 and so eqn 7.17 reduces to 
x+ $i; 20 


as required. Therefore the error-location number Y = S, = af which gives the error 
pattern x* (which we know is correct). 


Example Ten 


Given that the codewords c\(x) and c2(x), belonging to the double-error- 
Correcting (15,7) code constructed over GF (2^), incur 2 and 1 errors so giving 
(à) v(x) Sx! b 94 x84 984 Sa ed | 
(b) V(x) = x1? 4 xH T x04. x9 4 xT xP 4x 
respectively, determine c (x) and c(x). 


MEE — 
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(a) ‘The error syndromes are 

S| = vi (a) — o? 
$3 = vi (o?) =a 

over GEQ"). Substituting these into eqn 7.17 gives 
x^ + o x +- a = (), 

R ' 1 TE xte ph he hi 10 AA an 12 

yimspecthion we can see thata +a o? anda!’ a ^—9! Over GF(24) 
and so 
a Pu 7 
x" Fa xa = (x+ a y(x +a?) = 0. 


‘ * 1 J 4 7 

he roots of x^ -Eo x Fo =0 are therefore aœ! and o"? 
* f () Pa 

location numbers Y, =a" and X; = a", Hence 


e(x) "t x? ab. x"? 


; Biving the error. 


and so 
) 
oy (x) & x" pe xl! 4. xV 4 x? + x9 4 xO 4 x5 x4 1, 


(b) Here we have $, «a and S,=a'*. Therefore Si +S =a} +a 29 and 
eqn 7.17 reduces to x +a? = 0. The error-location number; Is Y, = =a" giving an 
error. pattern e(x)  x* and codeword c2(x)=x!*+x!! 4 x19 4 49 4E x! 4. 


E 


x" + xt x. [] 


To summarize, when decoding a double-error-correcting BCH code the occur- 
rence of two errors results in a quadratic equation whose two roots give two error- 
location numbers, However, in the event of a single error occurring, the quadratic 
equation reducestoalinearequation and theerror-location numberis given by S; (as for 
à single-error-correcting code). In the event of three or more errors occurring a 
decoding error will occur if eqn 7.17 has 1 or 2 solutions. If eqn 7.17 has no solution 
then an uncorrectable error pattern will have been detected. If the error pattern is 
identical to a codeword, then the syndromes are zero and again a decoding error 
OCCUIS. 


Example 7.3 

C onsider the (15, 7) double-error-correcting BCH code and codeword c(x) = x 
! A. x9 4: x* 4: 1. Determine the outcome of a decoder when c(x) incurs the error 

dicic 

(a) e(x) — X^ 4«* 3e ] 

(b) e(x) — g^! qe y? Je xo a. 


(a) The polynomial to be decoded is 
v(x) = c(x) + e(x) = x8 + xf + x* + x? 
giving error syndromes 
S, = v(a) — of -- oS -- o* c o? a 
S3 = (œ) =a + +a o? =l 
over GF(2). Substituting Sı and $3 in eqn 7.17 gives 
x? - al! x 4- o? =0. 


O 
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hown, by inspection or by testing the field elements, that none of 
ts in GF (2^) are solutions of x^ -- al! x -- o? 2 0. No error-location 

mbers can therefore be obtained and the decoder concludes that an 
| " correctable error pattern has been detected, i.e. a decoding failure occurs. 


xl 4x? + x8 4x74 1 and so 


[t can be s 
| the elemen 


b Here v(x) - 
i Sı = v(a) = o 
S3 = v(o?) = 0. 


Substituting 5| and S, into eqn 7.17 gives 


x! -o!x-4- al^ 20 


iex i E 4 o 3 4 
and by inspection it can be seen that o^ -- a^ 2 o! and o?a'? 2 a'^ over 


GF(2^). Hence 
x? +a x 4 al^ = (x - o?)(x 4- a?) 


giving o? and a!’ as the required roots and error-location numbers. The 
decoder therefore concludes that the double error pattern e(x)-— x^ +x’? 
occurred and adding this to v(x) gives the codeword 


c(x) = x? Hx x? 4x8 Ex! px rl. 


This is the wrong codeword and so a decoding error has occurred. go 


7.5 The error-location polynomial 


The method described in Section 7.4 for decoding: single error-correcting and 
double-error-correcting BCH codes can be extended to deal with multiple-error- 
correcting BCH codes. For a t-error-correcting code a polynomial of degree ¢ or less 
can be definéd whose coefficients are functions of the error syndromes. The 
occurrence of u € t errors gives a polynomial of degree u whose u roots are the 
reciprocal of the required error-location numbers. Consider again eqn 7.17 and let 


a, = $i 


a2 = (Si + 83/8 a 


then eqn 7.17 becomes 
x" + oix +02 = 0. 


Fas = polynomial of highest degree that we need to consider when decoding 
— x . 2 —Ü g codes. In the event of | error occurring we get oz = 0 and 
For a terror Š - 0, which gives X — g, = S, as the required error-location number. 

“Correcting code we need to consider polynomials of the form 


MM Áo o ———————-— 


Where j, < 
Synd i : and where the polynomial coefficients are again functions of the error 
‘and the y roots give the p error-location numbers. If we replace x by its 


r 
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reciprocal 1v and then multiply through by x^ we get 


* 
Qo + OX + IX 480, jx" ! D Cx" = () 


where oa = 1. We now define the error-location polynomial 
ETA 
n (7.19) 
which is a polynomial whose roots are the reciprocal of the error-location nup 
re 
The error-location polynomial can be defined so that its roots are etrorelocatic, 
. . 3 . . " tity 
numbers. and whilst it is easier to think of roots as representing error-log " 
tion numbers, it is however convenient and conventional to use error-locatior 
. b . aim 
polynomials whose reciprocal roots are error-location numbers. Note that for 4 
| 3 4 e ‘ 
double-error-correcting code the error-location polynomial is 


* 
| a(x) = M+ A,X + OWN” eo Oy |. X" 
| 
| 


a(x) = 1+ oix + ax? (7.20) 


where c, and o; are again given by eqns 7.18. 


Example 7.4 
Given that x)= 
error-correcting (15. 7) code, that has incur 


9 1S ula? 4: x44 1 represents a codeword c(x), of the double- 
red 2 errors determine c(¥). 


Over GAS) we get 
CT = 


S3 = v(a?) = 0 


i 


4 


and substituting these in to eqns 7.18 gives 


The error-location polynomial i5 therefore 
o{(x) = 14+ 0X7 oN =1l14+Nv+ an. 


Using a Chien search we find that the roots of o(x) are af and a? over GF(2"). The 


error-location numbers are therefore 
X; = | /a* 
X; 2 l/o* =a 


9 
Q 
7 


| 


which give the error polynomial e(x) = y? +x’ and codeword polynomial 


cix) 2 v(x) + e(x) = Sox xi. LJ 
If the roots of the error-location polynomial are the field elements 3), 3». . . . . J, then 


the error-location numbers are 


X, = 1/3 
X; = 10/8 
Y, = 1/0, 
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LOrJdocatron polynomial can be expressed as 
j= (x Xi ES Doct: T 1! Lon (xA, T 1). (7.21) 


" V p 
ano HS 
nR = 


| the error-iecation polynomial is the most difficult part of decoding a 
Deter The coefficients co Fr 92. -- c. of the error-location polynomial aix). 
- ietermined from the known error syndromes. To achieve this eqn ?.71 is 
pave to d its coefficients are compared with those of eqn 7.19. and in doing so 


x1; 


„panded ` 
ae = XpYS + XaXacR XN to + Aata (7.22) 


The coefficients o teix) as given above are said to be elementary symmetric functions 
-na error-lecation numbers. We now have two sets of equations involving the 
location numbers of a r-error-correcting code: 


"ara =) 
errr. 


>. 


V 
S & 


7 12 relating the error-location numbers to the error syndromes: 


(2) equauions 732 relating the error-location numbers to the polynomial 


coefficients. 


il) equations 


From these two sels of equations we can eliminate the error-location numbers to 
obtain expressions involving only the error syndromes and the coefficients of the 
error-location polynomial. It can be shown that for the first p error syndromes 


S; = GO} 
S. = 0151 + 20> 
S: = a,S> E aS) T 3c: (7.23) 


a = g15,-4 T o2S,,-2 2 ddl = Us 5 + HO p- 


Note that the last term ic, in each expression in the eqns 7.23 is 0 for even values of 
i and c, for odd values of i. The remaining error syndromes are given by 


324] = aS, + 035,4 +--+ 0,132 -f 8,5 
Sot = OS yoy + 03S, t 04-183 + GS? 
Syed = Op Spor + 02S pat b o + Op- S3 + 0453 (7.24) 


So» = 015S3,—1 + 02S>,,-2 Tes Gn’ - aS 
Equations 7.23 and 7.24 are a set of linear equations, referred to as Newton's iden- 
tities, from which the coefficients of o(x) can be determined. Although they are a 


m et of equations, they fall naturally into two groups, the first x equations given 
y eqns 7.23, and the remaining p equations given by eqns 7.24. For clarity, they can 


i RE ERES MES 
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be expressed in the matrix forms 


$i | 0 0 «. 0 O] fa, 
S S| 2 0 "rn () () T) 
SN 3 T S5 S'i 3 e086 () () O 1 
| (7,25) 
Su S-1 S, -2 $53 ses 5| fl 0,, 
and 
$a Sy Su- | Sy 2 Sy J T] 
Ma | Sut Se Se o Ss Slo 
Su+3 2: S42 S Hl S, TT S4 $4 03 
. . a (7.26) 
S524 $24-1 $2u0-2 324-3 = Sl 5, J Leu 


In Section 7.6 we look at the Peterson-Gorenstein-Zierler decoder, Which use. 
eqn 7.26 as the basis for a decoder for multiple-error-correcting BCH codes. Lote 
Berlekamp's algorithm is considered, this is a fast algorithm that uses eqns 7.23 and 
7.24. For the remaining part of this section, we look at how the coefficients of 
the error-location polynomial of a binary code can be obtained algebraically from 
eqns 7.23-7.26. 

For a binary code eqns 7.23-7.26 can be simplified by taking into account the 
relationship Sx; = S2. Consider eqns 7.23, using S2 = S1 we find that the second 
equation $5 — 215, + 202 reduces to the first equation S, — o, and can therefore be 
excluded. Likewise all the equations for S; with even values of ican be excluded from 
eqns 7.23-7.26. Furthermore we can combine eqns 7.25 and 7.26 to get 


S, | 0 0 TT ( () Oj 

$3 S2 $1 | TE () 0 02 

$5 — S4 $3 S e eie 0 0 01 (7.27) 
Siyi S24-2 D-3 Opak oee P$, Opi | | op 


For a double-error-correcting code the maximum number of correctable errors is 2, 
and setting u = 2 in eqn 7.27 gives 


Is|-[s sla] 


NY = gi 
$3 = $50, + S105. 


from which we get 


Rearranging these 2 expressions gives 
gj = Sı 
o = (Si + $3)/8i 


which agree with the coefficients of a(x) given previously (eqns 7.18). 
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he slightly more difficult example of a triple-error-correcting 


ve consider t | | 
location polynomial is 


Next V 


„de. Here the error- 
Ct A 


o(x) = 1+ aix E oa! + oy 


maximum number of correctable errors is u= 3 eqn 7.27 reduces to 


and as the 
S| | 0) () O | 
5 3 —-— 55 ‘Sj | 0 
Ss S4 ‘Sy 95 | O1 


which when expanded gives 


S| = 07 
S3 = S201 S105 + 03 (7.28) 
Ss = S401 + 5302 + $203. 


Multiplying the middle equation by S, and adding it to the last equation eliminates 
c, and ay, so allowing o5 to be determined 
S283, + $5 = (S3 + Sy)oy + (S381 + S4)o2 + (So + 83)o03 
= (S$ + Si)oi + (SiS + S3)on 
= (Si + $3)o 
and so 


à |» (S383 + S5) 
(S+S) 


| Now rearranging the middle expression of eqn 7.28 gives 
03 = $3 + S901 + S10? 


and we could leave o like this since 7, and o; are known. However, for complete- 
ness, we can substitute c, and o as given above into g, to get 


S (S28 + Ss) 
= 3 SEE C MEE 


Therefore for a triple-error-correcting code the coefficients of the error-location 
polynomial are 


g| = Si 
-— (S253 + Ss) 
(S$ + Ss) (7.29) 


Si (S283 + S5) 


= (S 3 
5 1 5) *7 SEES) 
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sample 7.5 


‘ven ag tiple erm eornrectiig vode aod error syndromes S | 
+ , | " i : r 4 A B^ ái , 4 
Na | over GPUPL ). tletednilie (he error location polynomial et g ' Y = At and 
. j X ' 
Cali ead 70279 gives | 
| | 
i| Si Fn | 
(NaN | Ne) (Waer 1) ut i 
iti d i ü |? (V 
(is) 1 Sa) lee” =f 67] (y's 
i SLAS I | a] YA La | 
ia a BIN N| T e (n | a) | (o o^ d " l) " | 
(iy, d op) (a? 4 a) "y | 
Ehe ertor tocation polynomial is herefore | 
| 
| j | | ( $ i 
H(A) EN F ge’ deduc mm T+ nox + aby? 4 4.) | 
NU, " 
| 


Ihe method described in this section ean be applied to any r-error-correctin 'OC 
However beyond = or 5 the resulting equations, relating the coefficients of ie 
einn Jooatien polynomial to the erro syndromes, become rather complicated s 
so this approdeh becomes impractical, Instead the Peterson Gore 
decoder Porma the basia For multiple-error correction, 


and 
nstem Zierler 


——Á——— ————À 


7.6 Ihe Peterson-Gorenstein-Zierler decoder 


We iie now in a position where we can consider an algorithm that typifies the 
decoding of REH codes, nainely the Peterson Gorenstein-Zierler decoder. This isa 
peneral purpose decoder that can be used For decoding any I-error-correcting BCH 
code ds based on the error Tocation polynomial, and as we shall see the decoder 
Hittipe together into a single alporithin the various ideas considered in the previous 
aci diens 

Ihe error syndromes 5,4 45: 9, 0 oso, ate related to the coefficients of the 
error location polynomial by eqn 7.26. By convention the order of the columns 
of the matis in equ 7.26 are reversed, along with the rows of the column vector 
containing (he polynomial coefficients, This gives 


à" i | | AY ^j AT TE Sy | S 0 | 
iUm * S he Ay TE S, Sud | On | | 
^y || T AT Ny V's "HP Su | S, » ji 2 (7.30) 

T ! SN Sj id Sj |J as S J Sap. | , 


Which ean be exspresied ns 


$ eu Ma 
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wher? Si S3 $3 xxi Spt z Su 
S2 S3 S4 Kor S, Sul 
Fm S1 S4 S5 cee S ul "e (7.31) 
Sa Sul Sp+2 S2,-2 S34-1 
Syl 
S2 
S= "- (7.32) 
$24 
gu 
94-1 
g= |1. (7.33) 
7g] 


„ming that M is nonsingular, so that its inverse M^! exists, and multiplying 
ASS E x we 
sa {g through by M ges 


M'S = (M'M)o =a 


4nd therefore the coefficients of the error-location polynomial are given by 


o=M'S. (7.34) 


To evaluate eqn 7.34, M has to be nonsingular and we need to know the number of 
that have occurred. It can be shown that the matrix 


errors H 
Si S$ Si sre Dij S; 
S> S3 S4 eae Si Si+ 
M-|$ Ss Ss .- Sii Si 
S; Si Sus =- Soa Sat 


is nonsingular if i= jj, but singular if i» ys. For example consider a code that can 
correct 5 errors but only 3 errors actually occur, so t = 5 and u = 3. Taking i = 5 and 
constructing 


Sı S2 $3 S4, Ss 
Sr S; S4 Ss S6 
M = 1S; Sq Ss Se 9$; 
S4 Ss Se S; Ss 
Ss Sg S; Sg Sg 
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will give det(M) —0, and so M is singular. Likewise the 4 h 
syndromes, obtained when i= 4 will also be singular, Howe 
number of errors that have occurred, ie. i= 44 — 3, the 3 fh 
singular. M^! can then be determined and the polynomial 
using o = M^! S. 

For a BCH code with error-correction limit 1, decoding Proceeds as foll 
decoder first assumes that the maximum number of correctable errors he O Ws, ' 
red, i — r, and constructs M and determines det( M). If M is nonsingular a Hur, 
and o = M'S can be found. If M is singular the decoder assumes that a ifn Mo! 
not occur and repeats the calculations on the assumption of | less error, je ri ors 
The decoder continues in an iterative manner, decreasing i by | ES a Ps]. 
found to be singular. On obtaining det(M) 7 0, the value of í ig taken mu T 
number of errors that occurred and a is determined, The main steps of the Peter, the 
Gorenstein-Zierler decoder are: "Thon 


y 4 matrix M of 
ver, when 
y 3 matrix A, 
coefficients Can he lina 
1 


Ihe 


did 


|. Calculate the error syndromes 5,, $5, ..., Sz, from v(x), 


ba 


. Assume the maximum number of errors, í — t, 
. Construct the matrix M. 


3 
4. Find the determinant of M and check if det(M) —0. If det(M) = reduce | b; 
| and go back to step 3, otherwise continue to Step 5. 7 


Uh 


. Determine M^ and construct S, 
6. Find the polynomial coefficients using a = M'S and construct alx) from a 


. Determine the roots of o(x) and take their reciprocals, The error-locatiog, 
numbers are given by the reciprocal roots, 


Asan example of how the decoder works, let's consider the triple-error 


| "correcting 
(15, 5) BCH code with 
v(x) 2 x* x5 xà txt] 


where v( x) corresponds to a codeword c(x) with 2 errors. For clarity, the example is 
referenced to the seven steps given above. 


Step! In GF( >") the error syndromes are 

Si =a +ó te tatl HI 
5 =f I. 
o? ta tatela 
S4 = 8; = of 
Ss =a +a al 441 =0 
Ss = $1 a, 


e 
Il 


Step 2 Assume the maximum number of errors, i= 3. 
Step 3 The matrix M is 
Si $3 S45 a o a! | 
M = $5 $4 S4 | = a a! af 
$3 5S4 Ss o! of 0 
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Ehe deter winan elt M (s 


x" t 
à 
it aa al! 
det M) = a’ aU at 
all at 0) 
; all at à at ak a* a 
e| a bo + a! 


arn a*a* tala? = a taf + a! as (). 


(he mattis M is therefore singular, so ig reduced by 1 to give i — 2 and steps 3and 4 


aue repeated 


ep Co repeated We now have 


Sep d repeated — Uhe revised value of det (7M) ts 


4 

a a 1 8 t 
4 T TL at 4 oO 0. 
(x i} 


det ( M) = 





Now M is nonsingular so we can move to Step 5 and find MS. 
vep Using M. ' = ad) (MD/deti M) we get 


a (^ a 


il — 4 
adiu. M) = W M 


and so 


L[a" a| [|o a 
we wc S will up 
Qc a Q a a 


Also 


Sepé Using o =M 'S gives 


e a alja |a ^: | 
M ^ taam 3 
Fy a a" a | e 


and so oy al, o, =a? and the error-location polynomial is therefore 


h Qu 14,2 
a(x) = Laux t+ ann = |o xa N. 
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Step 7. Using a Chien over GF(2") we find that the root 
the reciprocals of which give the error-locatic 


8 Of a(x) areg’ 


spect | m numb r 
respectively, The error pattern is therefore x! 4. x4 den E 


codeword polynomial is 


ANd qu"! 
‘ing a! 
| 50 the required 


n s — e " ( | 
C(x) = v(x) + VUE E PP, + x8 Lx Fx + x? 4. X 4. | 


In the example below the (15, 5) triple-error-correcting BCH cod 


"1 ; , 1 H E c if t 
sidered, but with a codeword that has incurred 3 errors, * again con. 


Example 7.6 

A codeword c(x), of the ( 15, 5) triple-error-correcting BCH code incurs error 

aum dem mi | 0, LÀ J 
as to give (x)=x +x +x +x bx tT, Find the number of errors that dió 
has incurred, the error pattern and c¢(x), a 


Over GF(2^) the error syndromes are 


5; = va) = a? +a! -- a + a4 fa+tl =a! 


55 == St = (Y ? 


( ( 4 4 
$3 = (æ) =a? +1 +a +a"? +a +1 =a" 
S4 -— s: — o? 

Ss = a + a B a P - a Toa | zs a? 


Se = Si =a’. 


Assuming the maximum number of errors, i= 3, we construct the matrix 


í 
a? aP a 
f 
M-—lo^ a" æ 
al" qa o? 


The determinant of M is 
det( M) — a" (] + a?) - a? (al^ + a") of- aV (al? 4- a) sz o. 


As M is nonsingular we assume that 3 errors have occurred, The inverse of M is 





0 | 0 
adj( M) a a a^ a a J^ 
MU = ap = (1/e") a^ a a a!’ a a 
eum a^ a af a? a” | 
and 
a? 
S= |a]. 
a? 
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-1$ gives 
00 0 = M S giy 
usins * : : 
- o9 a gl 2 á 
2 ~ —- 
m P an a"? a"? a - Q 
si alt @l® 4 a a! 
$ o=, 0 =F a" giving the error-location polynomial 
=U ~ 


and so 73 


o(x) = 1+ a" x 4- ax? + ox". 


|o GF(29) for the roots of a(x) gives o^, a9, and a"? as roots and taking their 
Searching Of » a. a?, and o^ as the error-location numbers respectively. The 
E is therefor’ e(x) 2 xP x? x^ and the codeword polynomial 
(xe E a a" x are T. " 


error pattern 
x)= v(x) +e 


The Peterson-Gorenstein-Zierler decoder forms the basis of decoding algo- 
Aims for BCH codes. It is a relatively simple decoder, as the reader should find 
anit king through a few examples. The matrix inversion does however pre- 
al spans to the decoder. For a large error-correction limit £, evaluating 
——Éà determinants can be computationally slow and inefficient. Further- 
more, as we shall see later, a second matrix inversion is required when dealing with 
non-binary codes, and so aggravating the problem. To develop fast decoding 
algorithms we need to avoid the matrix inversions, this is considered in Sections 7.8 
and 7.9. 


7.7 Reed-Solomon codes 


The codes considered so far have all been binary codes, and we now turn our 
attention to non-binary codes. At first the idea of a non-binary code may seem 
rather strange or of little practical use. Information processing, transmission, and 
storage is usually thought of in terms of a binary representation. Bits are manipu- 
lated either individually or in blocks of convenient length, for example as 8-bit 
wor ds. However, an 8-bit word can be thought of as a single non-binary symbol with 
Tm values, irrespective of its underlying structure (i.e. the fact that it is 
can Y collection of 8 bits.and not a single symbol). Likewise any sequence of r bits 
€ Viewed as a single non-binary symbol that has one of 2' values. Furthermore 


S , ; 
y mbols need not necessarily be restricted to 2’ values but can be defined for any 
positive integer, 


Non-bi , ; 
symboj eee codes are concerned with the detection and correction of errors in 
- The construction of non-binary codes, along with encoding and decoding 


techni u ; « . e a 
le e d Pi, -a directly from that of binary codes. The main difference arises in 


inary codec etermine the magnitude of errors and not just the error locations. In 


error ma ni 
lon of errors, O gnitudes a 


re l and it is only necessary to determine the posi- 
nce located error correction is achieved by simply inverting the 
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erroneous bits. With a non-binary code we first locate the position of the 
then determine the magnitude of the errors. errors and 
Binary codes can be viewed as codes whose symbols have 2 values, 0 
the code’s symbols lie in GF(2). A non-binary code has its symbols in t 
where q is a prime number or any power of a prime number. A non-bina 
linear code will have codewords of the form e = (c. 4, c, 5, ... , C2, C1, Cp) "i: (n, k) 
codeword components lie in GF(q) and there exists at least one set of k dcm ". 
from which all the other codewords can be obtained by linear combinations of -— 
codewords. A non-binary (n, k) cyclic code can be constructed from a nuni 
g(x) of degree n — k, where g(x) has its coefficients in GF(q) and divides x] Nor 
that for binary codes x" — | = x" + 1 and so g(x) can be said to divide the latter if it i 
lo generate a cyclic code. 
A rerror-correcting nonbinary. BCH code of blocklength n— 4". | jg à 


(n, k) cyclic code whose generator polynomial g(x) has its coefficients in GF(q) 
and roots 


and i that i 
he field G Fig) 


B, B7,..., 67 


in GF(q") an extension field of GF(q). Recall that the generator polynomial of a 
t-error-correcting binary BCH code is given by the least common multiple LCM of 
the minimal polynomials m{x), over GF(2), of 2t consecutive field elements. To 
construct a non-binary BCH code minimal polynomials over GF(q) are required 
and the generator polynomial of the code is given by 


g(x) = LCM [m|(x), m(x), . .., Mu (x)|) 


where now máx) is the minimal polynomial over GF(q) of 5. If q—2 then the 
minimal polynomials are binary and we obtain the binary BCH codes. 

The most important class of non-binary BCH codes are the Reed-Solomon codes, 
which differ from other non-binary codes in that the base field and extension field 
are taken to be the same. Both the symbols and the generator polynomial roots lie 
in the field GF(g) and define a Reed-Solomon code with blocklength n4 - 1. 
Here we consider Reed-Solomon codes where q — 2" and so symbols and roots lie 
in GF(2"). A t-error-correcting Reed-Solomon code is a cyclic code whose gen- 
erator polynomial is the least-degree polynomial that has 5, Iam cosa f?" as roots, 
where 8 belongs to GF(2"). The minimal polynomial over GF(2") of an element 
B in GF(2" ) is the factor 


mg -—-x-ctf 


as this is clearly the least-degree polynomial that has as a root. The generator 
polynomial of a Reed-Solomon code is therefore 


g(x) = (x + B)(x + B(x + B3)-- (x + 8^). (7.35) 


l . ors as 
Note that there is also no need to take the least common multiple of the fact 


all the factors are distinct. 
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ple-error-correcting Reed-Solomon code over GF(2*), taking 
u 


ives 
id g(x) = (x 4- a)(x + ad) (x + a?) x +0") 
ding this gives the generator polynomial 
expan 


p g(x) = x* - ax + ox? -- a? x +a". (7.36) 


s of g(x) are no longer binary. The code's blocklength is 
e degree of g(x) is r — 4, then using n — k =r gives k — 11 


he generator polynomial of an (n, k) cyclic code is n — k). 
tor polynomial of a double-error-correcting (15, 11) 


the coefficient 


t th 
Note tha _ 15, and as th 


E degree of t 
j] that the 
This is therefore the genere 


Reed-Solomon code. 


^ i | 

— 4 single-error-correcting Reed-Solomon code with blocklength 7. 
" LE 

The code is constructed over GF(2) as this gives a code with blocklength 


"E bee T. Substituting = 1 and =a in eqn 7.35 gives 
g(x) =(x+a)(x+ o^) — x! 4 o*x 4 a? 


where o is a primitive element in GF(2)). The information length k is given by 
L=n—r, where r=2 is the degree of g(x) and n — 7, and so k — 5. This is therefore 
a single-error-correcting (7, 5) Reed-Solomon code. C] 


For encoding purposes the Reed-Solomon codes can be treated as cyclic codes or 
a generator matrix can be constructed from the generator polynomial and the codes 
can then be treated as linear codes. For example consider the (7, 5) Reed-Solomon 
code with generator polynomial 


g(x) 2 x! -- ofx - à? (7.37) 


and let's construct the systematic codeword for the information word, say, i — (10 @ 


| o ) where æ is an element of GF(2°). The information polynomial corresponding 
i is 


i(x) = x* -- ax? -- oóx - o? 
and multiplying this by x"-* = x? gives 


x'i(x) = 8 + ax* -- a533 a? x. 

Recall tha 
divided by gfe, struct systematic codewords we require the remainder of x" *i(x) 
ensure that a, de e dividing two non-binary polynomials, care has to be taken to 
step the coefficients of the highest power of x are the same. The 
more awkward than that of dividing two binary polynomials, 


Vision is a bi 
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however the principle is the same. Dividing x^i(X) by g(x) we get 
x? + atx) a? x? + aix + o6 


1 M 
Aya! JS Fax of dal 
4 


\ ; o 
x5 4- aS + a? x 
g atx ae v 4- aix 4 atx 

a*x5 + ax* 4 x? 
- o - taw om 
5.4 ox) paix? 
— ax + x? 
a^x! + a*x? + ox 
_ a®x? + ax 
a®x? + o? x + ¢ 
---— 





and the remainder is therefore r(x) =x + a^. Adding r(x) to x^i(x) gives the code 
word polynomial 


at 4 & 
ctx) = xhi(x) + r(x) = x° ax, + a + atx? + x +9 


i § 21.2 
which gives the codeword e=(10 aa a | a^). 


Example 7.8 
Construct the (15, 13) single-error-correcting Reed- Solomon code and determine 


the systematic codeword corresponding tof=(00 0001 a'o?001aao *) where 
o ds a primitive element of GF(2^). 


The generator polynomial is 
" 
= (x +a)(x +a’) = x +a°x +a’. 


Note that the _— of g(x) is 2, which is consistent with the code's (n, k) parameters, 


nk —145 13= 2. The information polynomial corresponding to # is 


i( X) = ax! +x’ taxt + a^x +x ax-4 o? 


and dividing x (x) by g(x) gives the quotient and remainder 


9 | 9x8 + atx? + o*x5 + of + an xt 


g(x) = ax + a*x 
1 7? 
+ a^ x? + alx? talx + a? 
; | 
r(x) = xa^ -- a* 
respectively. The codeword polynomial is therefore 


j i . 
Pix) 4 r(x) = ax? 42° c a^ + 02x? 4x4 Fax o?! c aá xo 


which gives the codeword 


c=(00a001a a? 001 aa’ o? of). 





Reed-Solomon codes | 211 





)ofa t-error-correcting Reed-Solomon code has 2t 
8, (f^, ..., 8” and the degree of g(x) is therefore 


mial g(x 

r olyno 
The general? má for each root p, | bols is 2 d h 
actors number of parity-check symbols is 21 and as such a t-error 


linea! "^; Hence we ode with blocklength n can be referred to as a (n, n — 21) 


D in -Solomon € i Í i 
a rrecting rm ode Recall that a f-error-correcting code requires a minimum 
OQ on GC , 
_Solom 
eed 
ce 0 
distas dmin = 2t + 1 


f error-correcting Reed-Solomon code has 
nd 50 3 t- 
l linin —n-—k-4l 


fore the Reed-Solomon codes are maximum-distance codes. Note also 
efor 


and ther d distance, do, and minimum distance, dmin, of a Reed-Solomon 


that the designe 


me. 7 
-— -— kan of codewords in a non-binary code can be surprisingly large. An 
€ 


(n, k) binary code has ?* codewords as there are 2" distinct information vnd. p 
* le the (7, 4) binary code has 16 codewords. In a t-error-correcung (n, n — 2t) 
m lomon code over GF(q) each information symbol has q distinct values 
-= e are therefore q" *' codewords. For example each symbol of the single- 
- msetiny (7, 5) Reed-Solomon code has 8 distinct values and the code has 
ved codewords. Clearly decoding algorithms that avoid the use of look-up tables 
ave necessary with codes with such large numbers of codewords. | 

Decoding Reed-Solomon codes is achieved by first determining the error posi- 
tions and then the error magnitudes. The methods used for locating errors in binary 
codes can also be used in Reed-Solomon codes, the only additional theory required 
is for finding error magnitudes. In a binary code an error pattern of p errors can be 
represented by the error polynomial 


e(x) = xP! + P E eiae + yP! 


where pi. p2, ..., p, are the error positions. Taking error magnitudes into account, 
the error polynomial becomes 


e(x) = Vp x?! E p. x^ a ed yp, X^" (7.38) 


where y, is the error magnitude at the position p;. The decoder input is v(x) — 
c(x) + e(x) where c(x) is the codeword polynomial incurring the errors. Fora r-error 
correcting code the error syndromes calculated by the decoder are 


YE v(o' ) = cla) zs e(a') =s e(o' ) 


SO giving 


Si = y o? + yp?! +--+ + yp ab 
S> = (M on 4 yp, a^? db eus di Yp, a P^ 


S3 — Vp, o?! -+ Ypa P? + ase 4 yp, oc P» (7.39) 


S2, = yp a" P + y, oP? esse y, otha, 
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Recall that for binary codes we defined the error-Iocation number TRAMA 
define an additional term Y, = ry known as the error magnitude of the ith or we 


location number, and in doing so we can express the syndrome equations in th a 
convenient form “More 
Sy FiA + Fata o] YN, 

No hm | ERE EE YX 

Sy "ug | YN; rs e Ya (7 40) 
Sy = PAY YS pea y, 
We have already seen that for a binary code Sy = St, this though does Not apply to 


non-binary codes. Taking Sj gives 


} 


Si ( Yi X| | Y» Ny MESE m 
4: "x +) 2 2 52 = 
d? t | r5X5 4 rae d VN,» S2. 
Likewise we can show that Sy < 85 and clearly for a non-binary code 
4 2 
Sy # i 


and so the 27 error syndromes need to be individually evaluated. 

Pquations 7,40 consist of 2r equations with u unknown error magnitudes, along 
with known error syndromes and error-location numbers, which can be solved to 
give the error magnitudes, Before addressing eqns 7.40 for any value of t we first 
consider a single-error-correcting code. The decoder of a single-error correcting 
code determines two syndromes S, and S$), From eqn 7.40 setting t= 1 and p= 1 


(as the maximum number of correctable errors is 1) gives 
Si -— Y, Xi 
‘ (7.41) 
S3 = Yı x 


and dividing Ss by Sı gives 
$ XM . 
Si B Yi Xi i 


Substituting X, — 5/5, into the first expression in eqns 7.41 gives S; = Yi1(S2/51) 
andso Y, — S1/5;. Therefore the error-location number X, and error magnitude Y, 
of a single-error correcting Reed-Solomon code are given by 


A — 85/8, 
Y, = 51/55. 


(7.42) 


Note that if we let S5 = S1, then eqns 7.42 give 


| 


X, = S/S S, 
Yi = S/S m1 





p 


Reed-Solomon codes | 213 


hich are the correct error-location number and error magnitude for a single-error- 
whi | 
correcting binary code. 


Example 7.9 | ! | essa 
Consider the (7, 5) single-error-correcting Reed-Solomon code. Given that y» = ( | 

5 o 1 af a), where o is an element of GF(2°), corresponds to a codeword c with 
: single error, determine the position and magnitude of the error and the 
codeword c. 


The polynomial corresponding to c is 
v(x) = x? -- o? x* -- o?x? 4+ x? 4 05x + o? 
and in GF(2°) the error syndromes are 
S; = v(a) =a 
S2 = v(a?) = o. 
Using eqns 7.42 gives 
X1 = S2/S1 = a? Jo =o 
Y; = S1/S; = a? / æ = of 


giving an error location of x? and error magnitude aĉ. The error incurred by c is 
therefore a®x* and so the codeword polynomial is 


c(x) = v(x) + a® x” 

| =x +a°x* + o? x? + (14+0°)x? + ox + o? 

. 
=x +arxt+a2x? +a x? +a°x +o 

giving c = (0 1 o? o? o? af a’). O 

A decoder for a t-error-correcting Reed-Solomon code determines the number of 

errors u and the error-location numbers X,, X2,..., X 4 using any technique that can 

be used for a binary BCH code. Once the error-location numbers have been found, 

the u error magnitudes can be obtained by solving the first u equations in eqns 7.40 

for Yı, Y?,..., Y, Note that the error syndromes, given by eqns 7.40, are nonlinear 

functions of the error-location numbers, but linear functions of the error magni- 


tudes. Hence the error magnitudes can be obtained from the syndrome equations by 
using a standard matrix inversion method. Defining the column vectors S and Y as 


Si 
AL, 
S= |93 (7.43) 


Su 


Y= | *3 (7.44) 





Hid | Hose (teh) Flosquenphenm eod 





and (lie natis A ua 


4 4 j À i Y, 
i į | K { Y yt 
ji 
(7.45) 
i! ji qi 
"u AS MN Yi 
Ihen egna f M I an he written ae 
NV X y 
Mate Hal He column vector iS given by eqn 743 is not the san 
defied tar uae qni the Peterson. Gorenstein Zierler decoder a - MM 
ane polakon da oe His should not cause confusion, The matrix Y e not the 
vector A^ nre known tens, and so V can he found by inverting S and column 
1 y Wy Elieiebue the eroi magnitudes ape given hy we XY 10 Rive 
Yu X's (LA 
Mote iat XN canned be singular because pj nonzero a lati 
| i p nonzero and distinet errors 
banow or del i already 


Fuulinp envi magnitudes ih simpler than we may have at first expected. Th 
nonlinear: problem. faced. when determining the error locations does not ar 
Lusteiid (he error mapgnibudes are linearly related to the error syndromes and "s 
knowin eni dTocation numbers, However, as before, we face the computationally 
Inellicient process ol mast inversion, Later we shall see how this matrix inversion 


can pe cinnnvented (see Section 79). Decoding Reed-Solomon codes can be 
aaide as Follow 


| Find de number of errors p and eror Tocation numbers Xj, XariX by 
using any technique suitable to binary BECH codes, 


) Prom the error Jocation numbers construct the matrix X and determine its 
Hivere X 

(6 d he error magnitudes Vj; Yacc., Y, are then given by Y - X'S, where Sis 
the column vector constructed from the error syndromes 81,55 85 Sp 


Hie example that follows considers decoding à (15,9) triple-error-correcting 
Heed Solomon code. The approach used is based on the l'eterson-Corenstein- 
Z iler decoder with two matrix inversions, one for the error-location numbers and 
Hie other For he enror magnitudes ¢ onsider a codeword polynomial e(X), belonging 
Lo de triple eror correcting Keed Solomon (15,9) eade, that has incurred 3 error 
suo giving 


| | TS RP 
y(n) = afa qc t 4 amy 4 ox" palkita K oF a 








im 
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Over GF(2") the error syndromes are 


Sı = 

S = v(a?) = a?! -- al6 40% +a"? 4 916 40% 405 =0 
$3 = (œ) =a” +a” +a" +a" +a” +a” +a =a" 
S, = v(o^) =o! +a? 40% +07 4. o2 4 96 4. o6 = a! 
Ss = (af) = a8 +a” +a” +a” +a +a? 4. 96 =a 
Ss = v(af) = o5 4 a +a’? +a? +a” +a? 4 49 =a’. 


The decoder first assumes that the maximum number of correctable errors, 3, have 
occurred and constructs the matrix 


S| S S3 a 0 a^ 
M-|S; $ S,|—-|0 at a" 
$3 $4 Ss alí q!! a. ^ 


Evaluating the determinate of M gives 


T0 











det(M) = a 


a” oO 











- oS (o.? +a’) taaa - ol! 4 a"? es d 


Hence det(M) # 0 and so the decoder assumes that 3 errors have occurred (which we 
know 1s correct). The inverse of M is 





5 10 13 
Q^? Qa a" 
ad 
M^! - 3 j(M) -- a? o "m. 
et(M) "X of 


The coefficients of the error-location polynomial are given by 


a; oj al 7 fall "NM NY o^ 
? 

ts te m ad bat] m!gidgq aq]: 

g| a? o? a |] a’ o^ + a6 + 9^ l 


and so g; = 1, 05 — a!! and o, = o giving the error-location polynomial 


c(x) 21-o01x-- ox) cox) 21 - x oll?  o*x. 


Searching GF(2^) for the roots of a(x) shows that x = a, a’, and a^ are roots, and 
taking the reciprocals of the roots gives the error-location numbers X, =a’, 
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Y; = of, and X; =a respectively. To find the error magnitud 
MUCS We CO 
n 


Xi X? X3 o? a | Struct 
"- 2 2 
3 


The determinant of X is det(X) = o? and its inverse is 


l a o o 
X — a? o? o? 
o? o? o^ 


Using Y= X^! S the error magnitudes Y;, Y2, and Y; are given by 


Yı o? a" a a alt 4 915 E 
Y;|—-|o o o 0 | =]|a}” +a] = |a 
Y; ab o? o^||a^ ali 4 a! x 


! 3 yvy. 9 ! 
andso Y, =a", Y2 = a, and Y4— o. Theerror-location numbers Y, = 42 y. , 
and Y4— o correspond to errors in positions x”, x^, and x respective] tue. ; 
pattern is therefore Y, the error 


e(x) = o? x"? + a? x8 + a?x 
and adding this to v(x) gives the codeword polynomial 


0,7 
c(x) = x8 + ax? + o? x? + o? x? + abx* + al x? + o? x + of. 


Example 7.10 ; 
A codeword c(x) belonging to the triple-error-correcting (15,9) Reed-Solomon 


code incurs errors so giving 1 
v(x) 2 x? + ad x8 + al! x! + o8 x8 + a3? + a x^ + oo x? -- o? x 4- of 


determine c(x). 
The error syndromes corresponding to v(x) are 


S| ms a^, S? = 1, 53 m a!’ S4 = a’, Ss = 0,8. = o^ | 


over GF(2^). Taking «= 3 and substituting the error syndromes into eqn 7.31 gives : 


S| S» S3 a^ l a!l 
M-2|S$ S $4|2|1 o? o | 
S3 S4 $5 a? a? 0 
the inverse of which is found to be 
] a? o M 
M'-2|oQ a® 1j | 








so 
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Furthermore 


S4 j ( "L 
S = Ss e () 
S6 a^ 


and substituting M ! and Sinto eqn 7.34 gives the coefficients of the error-location 
polynomial 


O1 | o! a a a? 
0e2| 2 M^'!S-|o)? o | 0 | = ]a!! 
O) a^ 1 af a" a? 


Therefore the error-locition polynomial is 
a(x) -14 o? x + al! x? +a x 
TETE M $8 ld uas =; 
the roots of which are o^, o^, a ^ which correspond to error-location numbers 


X, — a9, Y =a", and x4 o? respectively. To determine the error magnitudes we 
construct 


X, X; X a? qq! qi 
A = x X3 X| =| a o 
AX XX 33 l a o 
and its inverse 
a? g6 w 
yet us a al? ap 
a? g^ gl 
along with 
S, ad 
$= | S| = l 
S3 a? 


Using eqn 7.46 the error magnitudes are given by 


Yi a? o a o | 
Y? ies o !! "i a? l des o? 
Y; o P? a? a! a!l a 


and so Y, = 1, Y? = af, and Y, — of. The error-location numbers X; = a", X3 =a, 
¢ 4 " 8: E s 

and X, — o^ correspond to errors in positions x!°, x", and x? respectively, the error 
pattern is therefore 


elx) = x9 + atx’ +.a5x? 
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and adding this to v(x) gives 


2.0 3.7 8 
dxj=ax’ + aU x! + abx® tafx igs 


X Fax apr o A 


T 
as the required codeword polynomial. 


7.8 The Berlekamp algorithm 


The Peterson-Gorenstein-Zierler decoder is fundamental to dec 
it overcomes the problem of solving the nonlinear syndrome equations b 

an error-location polynomial whose coefficients can be obtained by - m USE o 
matrix-inversion methods. This though is the weak link in the "lici — linear 
inversion requires excessive computation, especially for large matrices. In Or matrix 
for non-binary codes for which a second matrix inversion is required Bees 
the error magnitudes. As such the Peterson-Gorenstein-Zierler deco Ke inia 
inefficient and. whilst it is of prime importance in illustrating the ims ag 
decoding BCH codes it is, nevertheless, of limited practical use. ino 

The Berlekamp algorithm is a fast and efficient algorithm for decoding BCH 
codes. Like the Peterson-Gorenstein-Zierler decoder it uses the error-location 
polynemial, but it avoids the need for matrix inversion when determining the 
polvnomial coefficients. The algorithm is generally considered to be significantly 
more complex than the Peterson-Gorenstein-Zierler decoder. However its com. 
plexitv lies mainly in the proof of the algorithm, which we omit. 

The algorithm uses an iterative technique to find an error-location polynomial 
s(x) whose coefficients satisfy Newton's identities, as given by eqns 7.23 and 7.24. 
The algorithm starts by finding a polynomial a (x), whose coefficients satisfy the 
rst of Newton s identities. A suitable set of initial conditions is required to achieve 
this, otherwise the algorithm may fail to carry out the required number of iterations. 
The polynomial c (x) must not only satisfy the first identity, but it must be the 
polynomial of least degree that meets the requirement. Note that the superscript | 
in c (x) is enclosed in parenthesis to avoid any possible ambiguity with powers of 
a(x). Next a polynomial oix) is found that satisfies the first and second identities, 
again the polynomial must be the polynomial of least degree that meets the 
requirement. To find e^ (x) we first check if a (x) meets the requirement, if it does 
chen we let e" (a) = cU (x). Otherwise c! (x) is modified by adding a suitable cor- 
rection term such that the resulting polynomial has coefficients that satisfy the first 
two equations of Newton's identities. The modification to c (x) must ensure that 
ix) is the polynomial of least degree that meets the requirements. The pres 
continues iteratively. Check to see if c (x) satisfies the first three identities, ifit - 
then c "(0 2 c" (x) otherwise modify cx) to obtain a(x). Then m 
c P (xy. oU (x)... and so forth, until a polynomial c 2x), with coefficients så 


J s s iin. a : ial is then 
fying all the Newton's identities, is obtained. The error-location polynom! 


Oding BCH ¢ bs 


"^ cnr. 
a(x) = a'^" (x) 


the inverse 


j i 7 din 
and the error-location numbers are found in the usual manner of finding 


roots of cix). 





pe 


I] that Newton's identities relate the error syndromes to the coefficients of 
Re or-location polynomial. At each iteration in the algorithm the polynomial 
a. Ticients are used to estimate the error syndrome of following iteration. Let a(x) 
ao polynomial of least degree whose coefficients satisfy the first i Newton's 
e 
UR tibi we can express o (x) as 
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o) (x) 214 o (x) + ay Tex ap y^ 


where r; is the degree of o"(x). To test whether the coefficients of o'(x) satisfy the 
(i+ 1)th identity we compute 


Sua = ei S, T oV S, Toe. e Sr (7.47) 


which can be thought of as the (i+ 1)th syndrome as estimated or predicted by 
o (x). Adding Si; to the error syndrome 5;,, gives 


d; = Siz + Sixt (7.48) 


where d; is known as the ith discrepancy. Both S;,, and S d are elements in the same 
field GF(2") and the discrepancy is therefore a field element that gives a measure 
of the difference between the two error syndromes (as its name obviously implies). 
If d; — 0 then the coefficients of o‘(x) satisfy the first (i+ 1) identities and o? (x) 
is taken as the next polynomial o * (x), and therefore 


ot U(x) = o? (x). (7.49) 
The degree r;,, of o * (x) is the same as that of o(x), and so 
Ti+) = Fi. 


If d; #0 then the coefficients of o? (x) fail to satisfy the (i+ 1)th identity and o(x) 
has to be modified by adding a suitable correction term. The correction term is a 
polynomial that depends upon one of the previous polynomials o”)(x), such that: 


(1) the discrepancy d, Æ 0; 
(2) n, has the largest value 


where n, =k — r, and r, is the degree of x), The polynomial required is then 
given by 


a") (x) = o® (x) + (5. oto (7.50) 


and is 


the polynomial of least degree whose coefficients satisfy Newton's identi- 
lies up 


to the (i+ 1)th. The correction term in eqn 7.50 has degree i+ r, —k =i- my 
and sor;,,, the degree of o* (x), is rior i — n, depending upon which has the largest 


- `~ 
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value, and we can express this as 


ris) = maxí(r;, i — ny). 


" (7,5 
Once c^ (x) and r,. are found, the coefficients of go x)are I) 
next error syndrome ito estimate the 
^ 0 UE) (i1) t; 
Si = 0, Sii + 05, "Sit... opea od 
" "u (7.52) 
along with the discrepancy 
dj. - Si+2 E s S42. 
A note of d;.; 1s made in a table, along with the value of 
nijj—i-cl-rij;. 
Note that the degree of the correction term in eqn 7.50 decreases with increasing " 
k 


and selecting the polynomial with the largest ną value ensures that the resultin 
polynomial is the polynomial of least degree that meets the required identities, j 

For the algorithm to work correctly a carefully selected set of initial conditions are 
required. Such a set is one that defines two iterations, labelled i= —1 and j= 
shown in Table 7.2. 

A step-by-step description should help to clarify the algorithm. Given that the 
ith has been completed so that o'"(x) and d; are known, then at the (i+ 1)th iteration 
the polynomial o^ (x) is obtained as follows: 


Step 1 If dj - 0: 
Take o'"(x) as the next polynomial, and so 


al) (x) = aO (x) 


Fiz) — Fi. 


0, as 


Go to Step 3. 


Step 2 If d; zz 0: 
Find a previous polynomial o (x) such that n, has the largest value and 
d, ge 0. Then 


ao") (x) - a (x) Ae (34) 


ri+1 = max(ri, i — ny). 


Table 7.2 
Initial conditions for the Berlekamp algorithm 


i o'(x) rj nj di 
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Step 3 The polynomial a^ (x) is checked to see if 


: ‘ty Its c i . 
with the next Newton's identity, so determi oefficients are consistent 


ne 


^ 


| i+1) 
Si42 = c! 


{i+ 1) i 
l Sixt +o inl: 2x3 (i+1) 
i 2 5i + + Ory DEC «n: 


and the discrepancy 


di = Su; S 
along with 


May = I+] riy. 


Make a note of 


g* (x) 
i+] 
niii 
di. 
in the table containing the initial conditions. 
Repeat iterations until cC" (x) is obtained. 


Note that at each iteration the index i denotes the results of the previous iteration 
and the algorithm determines the polynomial for the current iteration, i.e. the 
(i+ | th, and then checks how well the polynomial satisfies the conditions for the 
next iteration, i.e. the (i+ 2)th. For a t-error-correcting code a maximum of 2f 
iterations are required. Furthermore note that if the degree of oC" (x)is greater than 
! then an uncorrectable number of errors has occurred. 

[n Example 7.6 the Peterson-Gorenstein-Zierler decoder was used to decode 
a (15, 5) triple-error-correcting code in which the error syndromes were S, 2a", 
S,=a’, §3= a!l, S,— a, Ss= o^, and Sg=a° where a is an element of GF(2°). 
Let's now repeat the example but this time using the Berlekamp algorithm to 
determine the error-location polynomial. The initial conditions required are shown 
in the first two rows of Table 7.3. 


Table 7.3 
The Berlekamp algorithm applied to a triple-error correcting code 
! oa x) li nj d, 
ERE. eee a 
—] 1 0 —| 1 d 
0 1 0 0 Q^ 
1 1 - a?x 1 0 0 , 
12 1 1 Q 
2 1+a“x : : 
3 1 £a? x c a? x^ 2 - 
4 1 - a" x4 a? : ; 0 
5 ltarx+ar+ax 3 


5 
lta x ox +a’: -—— 


e 
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First iteration 


The i= 0 row in Table 7.3 defines the previous iteration and so We start with ; 
determine o * (x) = o (x). From Table 7.3 we see that the discrepanc r - 
and so we skip Step | and go to Step 2. We need to find a polynomial =! fice 


Oan 
o? 


that has d, #0 and the largest value of ny. There is only one polynomia, o 
fore 


a (x), namely o (x) and so this must be used and therefore k=] 
crepancy d. , — 1 #0 and the required polynomial is 


Paetos (oe 


a? 
(5 
: 


- The dis. 





We can express of (x) as 
a (x) = 14 ox 
where c1! = a!?, The degree of ox) is 
rı = max(ro,0 — n.i) = max(0, 1) = 1. 


Proceeding now to Step 3 we need to find d; by first using the coefficient of ox) 
to estimate the next error syndrome 


s -— eis, n RE 


and so 
di = S.+ S$, — o? +a — 0. 
Finally we evaluate 
n =0+1-r, =0 


and make a note of (x), ri, nı, and d; in Table 7.3 (row i= 1). 


Second iteration 


Here i= 1 and we start by looking at the previous discrepancy d;. Since dj =0 we 


carry out Step 1 


a? (x) = oU (x) = 1 +a!?x 


fs =P) = I, 
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iig Seg j und carrying nut fep 4 ves 
{jiii 


A 2) 4» 4 
Ai : "i! M, f wh ' Hi d (i! nu ere 74 


lji 4,97 nnd 7 TEM IT dise eiii y i, ie 
wa rly 


, ty , 
ifi | Bla f ii T j if fa! 


ud i, | The resilta are noted in Table 7.4 ow i= 7j 
"mi í 


(hird, fourth and fifth iterators 

/ 
faking) 2, 3 4 and proceeding as WWustrated in the previous tio Weputraps gives 
ihe next Lee FOWA shown in Tatie 7 4 


bah iteration 
pake i= 5, the previous discrepianey is ds = 0, and eo Map d pres 


n (sj e n^ (x, uS Í $ n" x 4 tax’ ^ n x 

4 ` ; . oF 4 * ^ d 
f here is no need to contine further, for a tniple-error 4 eA Mg OE has t = 3 and 
sei o 68) — a is the last polynomial to be determined. The required eror- 


loration polynomial is therefore 


F: / 


ul x = bota gx 4 (a x* 
which is the same as that obtained in Example 7G 

H the number of errors pris ess than /, then not all 21 iterations are required. M the 
discrepancy d and the follawing m,=1 r- 1 discrepancies are zero, then 7 x) is 
the required error location polynomial, Adding this to the algorithm is SA raight- 
forward, each time d,— 0 we start Counting succksqye zero discrepancies, If the 
count reaches the required number m then the algorithm stops. Otherwise the count 
stops, is initialized to zero and counting recommences at the next zero discrepancy. 
Consider, for example, a triple-error-eorrecting code. Assuming the occurrence of 
at least one error, the first iteration gives 


o P (y) = E Sx 


Fi = | 
hy = 
d, — t 


And my, = y ri |=] asy 4, Therefore if the next discrepancy is zero there is no 
mw ' continue with the remaining iterations. In the event of there being just a 
single error the next discrepancy wil be zero, no more iterations are required and 


e era rlocation polynomial will be (x) — o (x). The next example iliustrates 
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Example 7.11 ee A Sd 
Consider the codeword c(x) 2 Xx "+x +x +x Lx" x41 belo 


(15, 5) triple-error-correcting binary BCH code. Introducing the 
e(x) = x! gives p(x) m x" xx +x'+x7+1. Show that the 
algorithm requires fewer than 21 interactions. 


nging to the 
single Error 
Berlekamp 


Over GF(2") the error syndromes are 
! 7 3 14 
$1 =a!', $4 5 al, $3 a, Sg =a", Ss =a", and S, = o6 


The initial conditions are shown in the first two rows of Table 7.4. 
At the first iteration we take the previous discrepancy dj — o!! 4 0, The oi 
iteration prior to this is ¿= —1, so taking A = —1 gives y 





0 
o (x) = a (x) + ( Jo - 1 4 al!x, 
X d_i 


The values of r, and n; are 


r= max(ro, 0 " nj) ex ] 


n| — | — Fi = 0 
as ro = 0 and n. , = — 1. To find d, we first determine 
$, = gt! Si — AL asd 


and so 
d, = S: + $, =a +a =0. 


Now m =t—r, — l = l as the error-correction limit t= 3 and therefore if the next 
discrepancy is zero we can stop. As d; =0 the next iteration gives 


ag (x) =o") (x) 2 14- a!!x 
and 


$, = os, + oV s, = allo! =a 


Table 7.4 
The Berlekamp algorithm applied to a triple-error correcting code with one error 

I a (x) lj nj d; 
Bg i te RN i eee 
—1 1 0 as] t 

0 | 0 0 a 

I 1+a''x 1 0 0 

2 1+a"'x 1 1 0 
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2) al! and of? = 0. The resulting discrepancy is 
as OF 


da = Sy F S4 es (y of cy) m () 


herefore no further iterations are needed and 
so there | 


o(x) = aV (x) es | 4. allx 


the required error-location polynomial. This is clearly correct because its root 
i d Le | * + , z i : 

- | /a, the reciprocal of which gives the error-location number o! and error 
" (V 1 è n 4 $ 

IS ) « x!!. All the remaining discrepancies must equal zero, we can check 


attern e(^ ' e ^ 1 ‘ 
‘ lculating S4, Ss, and Se. Note that o(x)@ t+ a's» gives o, a"! 


this by ca 
0 and so 


* 


03 7 03 
S4 <= "Y J|: 0353) 4 ays) - allo? - a 
$5 = OSa 0353 F 04) — all'al4 = o Pg 
S. = gi$s + 0354 + 0483 = allo s o 


which give the discrepancies 


dy = Sy t+ $4 x al^ +a'4 = 0 
da = Ss +t $4 =a} + 4,19 = 0 


ds = Sẹ + $, = Q^ + o = 0, 
Hence the coefficients of a(x) satisfy the required Newton's identities. 7] 


In practice it is quite likely that the number of errors is less than the error- 
correction limit t, otherwise the code would not be suitable for the given application, 
Hence the number of iterations required by the Berlekamp algorithm is normally less 
than 27. The algorithm described here applies to non-binary as well as binary codes. 
l'or binary codes the algorithm can be simplified so that a maximum of t, and not 2t, 
iterations are required; this is not covered here. Hence offering a further reduction 
in processing time. The processing time of the Peterson- Gorenstein-Zierler decoder 
increases significantly as ¢ increases, because the computational requirement 
for evaluating the inverse of a t by t matrix is dependent on (^. However, in the 
Berlekamp algorithm, the maximum number of iterations increases linearly with ¢ 
and there is therefore no significant degradation in performance when codes with 
large error-correction limits are used. 


75 The error-evaluator polynomial 


Here 
matri 
a 


we consider how the error magnitudes can be determined without the need for 
X inversion. Consider a t-error-correcting Reed-Solomon code and let's 
ssume that the error syndromes $1, S2,..., Sx have been determined along with the 
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number of errors pz and the error-location polynomial 
o(x) = Il +toix+ OIX? +06 + Ox" 
To find the error magnitudes we first define the error-evaluator polynomial 


À 1 
w(x) = 1 wix t wax + wx". (7.53) 


where 


wy = $1 +0 
wy = S2+0)S; +02 


QJ, = S, T 9154-1 ^ 0259,-2 dore Ou 


Once the error-evaluator polynomial is determined, the magnitude Y; correspond- 
ing to the error-location number XY; is given by 


(X; ) 


FK; —————————iávi:—niviri 
1 (TE XU) + X139) (1+ XIX) 


(7.54) 


where the product on the denominator excludes the term (1 + XX j). To illustrate 
the algorithm we reconsider the example covered in Section 7.7 in which the 
Peterson-Gorenstein-Zierler decoder was used to decode a triple-error-correcting 
(15,9) Reed-Solomon code. Here 


v(x) = adx? + x8 + ax" + a2x5 + ax* + alt + of 


and the error syndromes were found to be 


S| = af, S> = 0, S3 =q 


$4 — all, Ss — a^, Ss = a’. 


The error-location polynomial was found to be 
o(x) = 1-+xX+ ay? + atx? 


which gave u = 3 errors with error-location numbers Aye a", X,= af, and X4 =Q. 
For p= 3 the error-evaluator polynomial, given by eqn 7.53, reduces to 


w(x) = 1 + wx wax? + wax? (7.55) 
where 

wi = S1 +0] 

w: = $2 +01S1 +02 (7.56) 


w3 = S3 + 01$? + 0281 + 03. 
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of o(x) are 21 = 1, o2=a'', 04 - o? and substituting these, along 
;yndromes $1, S2, 53 into eqns 7.56 gives w, =a", uw; — a, wal 


with the error ? 
and therefore 


w(x) = 1 - a? x + ax* alli? 


error-evaluator polynomial. To determine the error magnitudes we 


ired b 
iş the require (x) at the inverse error-location numbers, this gives 


first evaluate w 
oU!) "i wla?) = | + aba! + aa ^^ + alla 36 - a! 
o( X7!) = w(o $)-14 aa^ + aa" + alla! = a! 


S PN I3, -1 ZIP 
W(X) 2w(a )=l+a'a +aa “+a a Q. 


2, 3 and substituting w(XT!'), w(X7'), w(X3') and Xi, X;, X4 into 


. j=], i 
E 7.54 gives the error magnitudes | 

E w(XT') m a! mpe 

n= (1+ X7! X5)(1-- X7'X3) (1-0 o^ 208)(1-- a^a) 
ao a MEM 

V = AFX XN +X A”) (1 +a%a)(1 + ata) 

y w(X;') Q 2 

3 — 


(13 X5; XOX A) (1+ ala) (1+ a7la6) 
as obtained previously. 
Example 7.12 


Repeat Example 7.10 but now using the error-evaluator polynomial to determine 
the error magnitudes. 


From Example 7.10 we found that the error syndromes, error-location numbers and 
coefficients of the error-location polynomial were 


S| = aĵ, S» = l, $4 =a", S4 =a, S5 = $1 = a!’ 
Xi =a", X42 ol, Rad 
g, = a’, g5 = a. Ü = a>. 

The error-evaluator polynomial for 3 errors is 


w(x) = 1 +wx + wx + w3x? 


where 

wi = S1 +0; = ag? 

w2: = S5 + 01S; +o,=a' 

w3 = $3 + 0,82 + 02S; +03 = a? 
and so 


w(x) = 1+ ax + atx? + aw. 








228 | Bose-X haudhuri-Hocquenghem codes 
Evaluating w(x) at the inverse error-location numbers gives 
wl XT!) = wa") = at 
w(X5') =w(a-’) = 1 
w( X!) = wla) =o 


and the error magnitudes are given by 


JE YE UG) » LL o 
(] + X, X) + X7 Xa) (1 + a9 G7) (] ra o Mi) = | 
y, == —— W(X") - ] E 
(LA XS XV +X A) +a aTe 9 
w( X4!) i 


Yi um —————À— MÀ e Maa c y D 
—O (0o X3 X) +X) (+a) + 7397) ^ 


a5 obtained in Example 7.10. 


Problems 


7. 4 


Show that a, o^, o^, and o^ are roots of g(x) =x + x! 4- x5-E x^ 4.1, the 
generator polynomial of the (15, 7) double-error-correcting binary BCH code, 
where o is a primitive field element of GF(2^). 


7.2 The (15,11) single-error-correcting binary BCH code has g(x) 2 x* -- x 4- 1. 
Show that œ, o? and of are roots of g(x) but that o? is not a root, where wis a 
primitive field element of GF(2^). Find the fourth root of g(x). 


7.3 Construct a single-error-correcting binary BCH code over GF(2?). 


7.4 Show that the triple-error-correcting binary BCH code constructed over 
GF (2°) has generator polynomial g(x) = x'? + x -- x? + x* + x^ -- x+ 1. Deter- 
mine the code's blocklength and information length. 


7.5 Given that the minimal polynomials of a and o? in GF(2)) are 

my(x) = x! - x^ +1 

m(x) sy ix dr t til 
respectively, construct a binary double-error-correcting code over GF(25. 
Codewords c; and cz, belonging to the (7,4) single-error-correcting binary 
BCH code, incur single errors to give vj —(00 10 10 1) and v; 2 (1011010) 
respectively, Using eqn 7.13 find c, and c;. 
7,7 Given the (15,7) double-error-correcting binary BCH code and decoder 

inputs 


7.6 


~ 


v =(100011011000101) 
v = (00101011101000 1) 
use eqns 7.18 to determine the resulting error-location polynomials. Hence 


show that v; contains an uncorrectable error pattern and v, contains 2 errors. 
Find the codeword that v; is most likely to represent. 








^ 
?.8 
'£ 
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The Peterson-Gorenstein-Zierler decoder is used for decoding the triple- 
-correcting (15. 5) binary code. Given the decoder input 

n 24 x8 4x! xS EX EX +) 

od the resulting error-location polynomial Hence find the codeword 

polynomial that v(x) corresponds to. | 

Show that the single-error-correcting (7, 5) Reed- Solomon code has gener. 

ator polynomial g(x)- x^--o^x--a' where a is a field element of GF j- 

Determine the systematic codeword corresponding to i; —(0 a Í 0 o^) and 

the nonsystematic codeword for i2 = (o 100° a’). Given that a is à root of 

g( x) determine whether v; —(1 0 a a* a? 1 0) and v; — (0 of af a! 0 6 1j are 

codewords. 

Determine the generator polynomials of the double-erros-correcting (15, 11) 

and triple-error-correcting (15, 9) Reed-Solomon codes. 

A decoder for the double-error-correcting (15, 11) Reed-Solomon code uses 

the Peterson-Gorenstein-Zierler decoder to determine the position and 

magnitude of errors. Given that the input to the decoder is v — (1 o” o” o” 

a à? al? 0 0 00 a 0 0 0) determine the decoding decision. 

Repeat Problem 7.11 for a decoder that uses the Berlekamp algorithm for 

determining the error locations and the error-evaluator polynomial to 

determine the error magnitudes. 





. Convolutional codes 





We have seen that with an (2, &) block code, codewords are construc 
dently ofeach other, Fora binary code the n bit output ofan encoder depend 
on the & bits entering the encoder, The n & parity bits of a codeword depend on il 
& information bits that enter the encoder, each information bit affects only - 
codeword, Convolutional codes differ from block codes in that the oncoder output i 
constructed not from a single input but also using some of the previous encoder 
inputs, Clearly memory is required to achieve this, to store inputs for further use 
A convolutional code that at a given time generates » outputs from k inputs and 
(m previous inputs is referred to as an (n K, m) convolutional code. 


led indepen. 


5 solely 


8.1 Convolution 


As their name implies, convolutional codes are based on a convolution operation 
and it is useful to take a look at this before considering convolutional codes. The 
mathematical operation of convolution can be applied to analogue functionsand to 
discrete functions, here we address only discrete convolution, Figure 8.1 shows a 
shift register consisting of 4 srages which feed into a modulo-2 adder via the links 
81 82 ga And ga, each stage is a l-bit storage device, The input to the first stage also 
feeds into the modulo-2 adder, via the link go. The terms £0. 21, 22, £3, and g4 have 
values 0 or 1 if the link is absent or present respectively. If all the links are present, 
then go = 8) = 82 = ga = g4 = 1. The shift register shown in Fig. 8.1 is an example ofa 
linear feed-forward shift register as bits are fed towards the output and not back into 
the shift register. 
Consider the sequence of bits 


u = (No My uz...) 
entering the shift register shown in Fig. 8.1, and let 
v= (vo Vi V. J 


be the sequence of bits leaving the modulo-2 adder as u enters, The sequences u and v 
are referred to as the input sequence and the output sequence respectively. If we now 





Fig. 8.1 Linear-feedforward shift register with 4 stages. 
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(all the links in lig. 8.1 are necessarily present, so that go, gi, 29, 23, 
n once ug enters the register, the output from the modulo-2 adder 
i Il the other inputs to the adder are zero. If uo = 0, or if the link 

(so that go 0, then vo = 0, otherwise Vy I, When u enters the register, 
"oves into the second stage, H gi = IF, then uo is fed into the adder and 

the bit Ho m | then uo is also fed into the adder, The output from the adder is 
likewise, I Ro 7 luogi: At the next input the adder output is y = tgo + Uig, + 
iugo V og d Hago F dogs and va = Hago + Ugi + Hoffa +F Uy 24 + 


‘gg bsen 


Hio 
followed by V1 


vo) = Mogo 

vi = Migo F og 

V) == MgO F Migi + MOR? (8.1) 
Và = Ugo F vagi F ui g2 d- Mog; 

V4 = Mago F URI + Ug A Ugy + Hog. 


Note that the first bit uo to enter the register has affected all 5 outputs. As the next bit 

„u. enters the shift register uo will cease to contribute to the output sequence. In a 
5 ' , 

register with p stages each input contributes towards m + | outputs. 


Example 8.1 | mE 
Consider the shift register shown in Fig. 8.1 and let g9=1, gi — 1l, g3—0, g3=0 
and g4= l. Determine the output sequence for the input sequence u=(1 1010 


| ss 


The first 5 inputs are uo = 1, ui = 1, u5 =0, u = 1, and u4 — 0. Using eqns 8.1 gives 


Voc l.*1zl 

vy, =1-l+1-1=0 
2=O-l+1-1+1-0=] 
y3=1-1+0-1+1-0+1-0=1 
4=O-l+1-1+0-04+1-0+1-1=0 


as the first 5 bits of the Output sequence. The 6th bit is given by 


V5 = USO + Uag| + u3g2 + U283 + ui ga 
=1-1+0-14+1-0+0-04].] 
= 0. 


The output sequence is therefore(101100.. J = 


^ x = ! —— input v rre we need to ensure that the last input feeds through the 
required. ad mer a the output. To achieve this an additional m zero inputs are 
irs sider Ig. 8.1 again, with the input sequence u = (uo ui U2 U3 u4 us ug U7). 

7 enters the register the output is 


V7 = UIBO + U6gI + usg2 + u4gs + 384. 


RB 
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Assuming new an additional 4 inputs ua, uo, Uio, and uj, then there are a further 4 
eu puta 

Vg = Halo + 721 F UE + sg3 + u4ga 
Vo = Mola F Magi + 182 + U683 + usga 
Nid = Wiogo + Uggi + ugg2 + u7g3 + uoga 
Vii = Higo + M081 + Ugg? + ugga + uyga 


anl SOLLE tiy Hu Higa > lii an () gives 


Vy = HIB) + H6E2 + 523 + Ugga 


M = UIE? + U63 + U5R%4 
vin: = 723 + u6g4 
rit = UEA. 


Allthe / tiputs have now left the shift register and the output sequence is completed, 
Any Durther zero inputs will give a zero output. By feeding in the additional m 0 bits 
(he register is said to be cleared or returned to its zero state. The m 0 bits can be 
appended to the input sequence u but should not be confused with the information 


Niis 


Example N.2 | 
vigure 8.2 shows a shift register with 3 stages and go = 1, g, —0, g2= 1, and g4— 1. 
Detecimine the output sequence given the input sequence u — (1 0 0 1). 


Ms (ua Hp uo ua enters the shift register, the output from the adder is 


Vo = Uogo 

Vi = uio T uogi 

Vo = Mago + Ugi + uog2 

Vi = Hago F uogi + 4182 + uog3. 


Substituting the values of go, £1, £2, and gs gives 
Vo = HQ 
P = uy 


¥2 = U2 T uo 
Vy = Wy + Ui + uo 





ae- —— mea 


Fig. 8.2 Register with 3 stages. 
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-Q, u = 0, and uz = l, we get vo = l, vı =0, v; — l, and v4 =0. To 
sb its zero state we need another 3 inputs, vq = us = ug = 0. This 


2 m "he register to t 
cetur * s 
pu y, = 4480 + N32) + ug Toug: = 0 
ys = Msgo + HAF t M32 ^us = | 
Ve = Hego $ USEI + Mag? + g3 = I. 
put sequence IS therefore r = (vo vi v2 Ya Pa ys vg) =(10100 1 1). o 
The output ? 


> eqns 8.1, for the shift register shown in Fig. 8.1, given the input 


ing now EC 
Returning Nt | decine 
- »utput from the modulo-2 adder is 
tact 
M vs 


v, = WMO + M181 E Mj-282 + Uj-383 t Uj-4ga 


yr more concisely 
UI oes 


4 
e == ) pork, 


r=0 


where u; =0 ifj « r (this defines u — u.2— 4.37 u.4— 0). For a shift register 

< ihr i à * ` 

with m stages and links go. £1, 82... &m feeding into a modulo-2 adder, the output 
tas ees — eae Lb" m - 

from the adder is given by 


m 


yj m$ jorg (8.2) 


r=0 


where again u,_, = Oif j <r. Equation 8.2 shows that each output v;is a convolution of 
(m + 1) inputs with go, g1..... £». We can think of convolution asa process in which 
a window of (m + 1) bits are multiplied by go, g),..., gm and added together. The 
window is then slid along the input sequence by | bit and multiplication and sum- 
mation repeated. The process continues until the window has covered the entire 
input sequence. Equation 8.2 can be expressed in terms of the input and output 
sequences as 


y—ueg (8.3) 


where the operation è denotes convolution and g = (gog|...2,,) is referred to as 
à generator sequence. The generator sequence can be obtained by inspection of 
the shift register or alternatively by considering the impulse response when the 
mput sequence is a 1 followed by m Os, i.e. u —(1000... 0). For example, consider 
agam Fig. 8.1 this time with input sequence w= (uo uj Uz u3 u4) where ug — 1 and 
Hi — u= u= us —(. Substituting uo, t, u», u3, and u4 into eqns 8.1 gives 


vo = lgo = go 

"i = 0go + lgi = gi 

v2 = 0go + 0g; + 1g» =g 

"3 = Ogo + Ogi + 0g; + 1g3 = g3 

v4 = Ogo + 0g; + Og2 + 0gs + 1g4 = g4. 
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Hence the output sequence is 
y = (Vo Vi V2 V3 V4) = (Z0 2) 828384) =g 


and therefore the impulse response gives the generator Sequence g. Th 
. The 


sequence g should not be interpreted as the generator sequence of the uf. Mor 
register 


but rather of the output from the modulo-2 adder. A line of stages feeding ; 
than one modulo-2 adder will have a generator sequence for each "m (a More 
: 9Xample 


8.3 below illustrates this. 


Example 8.3 
Figure 8.3 shows a shift register with 3 stages feeding into two modulo-2 adder 
S. 


The output v; does not have an input directly from u nor from the first stage, but 
has inputs from the second and third stages. Hence the generator sequence va 
is g; — (00 1 1). Likewise we can see that the generator sequence for V) is ess 


(1 0 1 1). Using eqn 8.2 gives 


Vo = Uogo + u—181 + u—282 + u-323 
Vi = Ugo + Uogi + u—182 + u—283 
V2 = U280 + U1 81 + uog2 + u-1g3 

V3 = U380 + U281 + 4182 + uog3 

V4 = U4go + u3g1 + U282 + 4183 


for an input u = (uo uj uz u3 u4) and substituting the values of g; and g» we get 


yg — O 
yj = 0 
y2 = uo 


v3 = uj + uo 
V4 = U2 + úl 


Vi 


V2 


Fig. 8.3 Register with 2 outputs. 








4nd 


Yo = Mo 
Vy = Hi 

y» = W^ + HA 

ya = U3 $ U] > lig 


Vg — Mg T Uu» + HJ 


[.] 


as the components of v, and r respectively 


3.2 Encoding convolutional codes 

with the notion of convolution now established 

ing aire pet codes. Figure 8.4 shows an anal ove on to looking at encod- 

Mam 4 x 

ms eT me oan cer ik 

convolutional code es pnay have the same number of sta ie iiri, shift 

as the memory " e maximum number of stages m in any s Se For an (n. k, m) 
ry order of the code. The encoder MÀ tena en Ec 

s taken from n modulo-2 








Pt Ke 


g. 8.4 í " | C O de 
Oo a 


CE 
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adders whose inputs are taken from various stages (depending upon tl 
code). Each bit in the encoder can affect any of the n outputs, and dim ES 
can stay in the encoder for up to mn 4- 1 inputs then each bit can affect u và -" 
output bits. This measure of the extent to which an input bit affects : 9 h(m 4. | 
referred to as the constraint length. "e Output 
The input sequence to the ith shift register is denoted by 


T 


i (i) (0 0 
u = (up uu...) (84 


and bits are fed into their respective shift register one bit at a time Viewir 
encoder on the whole, bits enter in blocks of k bits at a time, and we can ations ^ 
“PCOS Ehe 


input sequence to the encoder as 


u= (up up iu Yl) TAS I (8.5) 
Here the first input to the encoder is the block of k bits ul ul? aP ul followed by the 
block ul ju)... ul and so forth, The output sequence of the jth modulo-2 adder is 
pl) (vl) JU JU " (8.6) 

and again viewing the encoder on the whole the output sequence is 
ECL SERIE A A) LED (8.7) 


where now each block leaving the encoder contains n bits. This may sound like the 
structure that we have in block codes, here however an n-bit block leaving the 
encoder depends not only on the &-bits that entered the encoder but also on up to m 
previous blocks. This is quite unlike block codes where each n-bit codeword depends 
solely on a single &-bit information word. 

If u is a finite sequence then we define the /ength L of u as the number of k-bit 
blocks (giving a total of kL bits). An input u of length L gives an output sequence vof 
length L -F m (atotal of n(L + m) bits) where each block of v contains n bits and where 
the last m blocks of v arise from the additional m zero inputs that are required to 
return the encoder to its zero state. 

A shift register feeding into n modulo-2 adders requires n generator sequences to 
determine the 1 outputs. Hence each of the k shift registers in Fig. 8.4 requires 7 
generator sequences and therefore the encoder for an (n, k, m) convolutional code 
requires nk generator sequences. Figure 8.5 shows an encoder for the (4, 3, 2) con- 
volutional code. The encoder has 3 inputs, 4 outputs and memory order m = 2, We 
can think of the input sequence u” and output sequence v” as being connected 
together by a shift register containing no stages. Hence the encoder can be con- 
sidered as having 3 shift registers and therefore a total of 12 generator sequences are 
required to determine the output. 

Each generator sequence has m -+ 1 terms, and we let 


AA) 
gli) - (ef us » (4)) 


b , Then 
denote the generator sequence connecting the ith input to the jth output the 
pecting 


by considering the impulse response of cach shift register or by ins 


| md. 
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Fig. 8.5 Encoder for the (4, 3, 2) convolutional code. 
g. os 


connections to each adder we find that 


g^" = (100), g^? = (100), 7? = (100), ¢"9 =(100) — (8.8) 
gi!) = (0 0 0), g^? (1 l 0), g^? P (0 l 0), gA - (J 0 0) 
gil) = (00 0), go? — (0 1 0), g3) ani (1 0 1), g ^^ E (1 0 1). 


In Section 8.1 we saw that given a generator sequence g, the output sequence v for 
an input sequence u is v = u«g (eqn 8.3). For the encoder shown in Fig. 8.5, each 
output sequence has contributions from up to 3 inputs and therefore eqn 8.3 has to 
be modified to take the additional inputs into account. This is achieved by adding 
the term u? s ¢") term to v” for each input uw. For convenience we define 


pis) — yu. g ^^ (8.9) 
as the jth output arising from the ith input. The rth component of y^ js 
y) — ul’) gid + ul g^ + uM gil (8.10) 
The jth output sequence can be expressed as 


vD = yl) 4 (24) 4 pB) (8.11) 
Which has 


V = yl) 4 22 4 y (8.12) 


aS its rth 
seq component, From eqns 8.10 and 8.12 the components of each output 
nsider first the components of the output sequence 


arising from the ith input is 


uence . 
v The i be determined. Co 


component of y(D 


i] . í ‘ , 
Hi e gf) P gp + dag 
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and taking f= b, 2, and V, along with values of gh! already given, we obtain 
p as yt a att O thO = al) 
iO 4 uq u0 = 0 


ut 0 | u 0 | THA = () 


(dii) a 
ye 


(M) as 
J^ 


Which added together give 


TURPE DUMP ULL US 


Proceeding in the same way, we ean show that the rth component of all 4 output 


"edguenmnecs ape 


(8.13) 


$ 
il jin | 4 Eu ae a, 


yE” "n bl) Wl? 4 ul A 


and the output sequence leaving the encoder iN 


í [2 | J \ 4 
(4)... (4 in (4) (^) "um ) yf DAD: M ye). 


Fo (Wy My My V My MEY 


lxnmnple X 
Determine the output sequence from the (4, 3, 2) convolutional encoder, shown in 


ip 8,5, piven the input sequences ut — (10 1), a « (110), and aC «(0 1 1), 


Ihe input sequences are of the form ae (noti dy) with u= 0 if r <0, We start by 


taking r- 0, then from equs X. 14 


(1) (1) 
Vo MUT 
2 | 
Wy yok * 
(4) (1) (4) 
0 My d j 
4 
yn) ul | ul E ul ') 
2 
and substituting ur! l, uir ' ui () gives ye) inen l, (us 0, v” y m" and 
(4) 
V 0 
ü | 


Next take r= 1, this gives 


V ms ul m O 

P ts yl 4 ul 1 it Y uj a () 
UER EE ET NT 
ETE 7 | a) a x () 


Vi à MW 
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) 
and for r= is "2 
V3 H^ 
vU = gi f uU i ui) T V = | 
sO) ce el eu ee) ae) NE 
" = i = T "T us + uL = (), 


` ij r "e "3 "5 
he inputs are finite sequences and m =2 we need to consider 2 more 0 
v vo) 1B b 4 4 h 
inn the encoder back to the zero state. This requires 


inputs to return 


2 3 
ii! = yi?! = u ^20 
2 3 
ul = 7 = ul ! = 0. 
For r = 3 we get 
l 
f us auf a 
2 2 3 
yi?) = uj + ut + u} E us ES 
2 3 3 
pi> = uj! + ul ad Pa. ui 2] 
(4) (2) 


3 
nV = ys TU + uv) JT ul P= | 
and r= 4 gives 


OY! e 7 = 0 


y = 
yl?) = uy Jj T + UC + us =0 
vi? = ui! + a + T T uS = | 
we = u$") + ue $ ue $ ul = |, 


Therefore the Output sequence is 
»=(1010,0000,1110,0111,001 1). m 


: The rth component of the output sequence, given by eqns 8.13, can be obtained 
rectly from the encoder shown in Fig. 8.5. Let's assume that the input sequence is at 


t è 
he rth component, so that uth, ut?) and uU are the inputs, then the 4 outputs can be 
determined by 


modulo-2 adde 
given by eqns 8.13. The output v has: 
(1) inputs directly from y” 


(2) i ; SO contributing u!” to y? 
) inputs directly from y?) 


which contributes ut”: 
(3) a contributi (2) " i 
(4 | ution from u that is delayed by | stage and therefore contributes Tid 
à Contribution from yu? 


uO topa that is also delayed by 1 stage and therefore contributes 


inspecting the encoder. The output v" has only one input to its 
r, namely that which arrives directly from u' and so yi") - uth, as 


LE OO m —— ee 
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Adding together the four contributions gives ul au a u Fu. as 
component of y which again is in agreement with that given by eqns ^re he y th 
wise we can verify that VI? and v, are as given by eqns 8.13, (s Like, 
^s with blockcodes the error-control properties of convolutional codes —_— 

on the distance characteristics of the resulting encoded sequences, However with 
convolutional codes there are several minimum distance Ineasures, the aa 
important measure being the minimum free distance defined as the minimum din 
tance between any two encoded sequences, If two sequences v, and " -— i 
different length then zeros are added to the shorter correspondi ng input sequence of 
or u, so that the sequences are the same length. Hence the definition of free di ! 
tance includes all sequences and not just sequences with the same length, Con. 
volutional codes are linear codes and therefore the sum of two encoded seq uences . 
and v; gives another encoded sequence v4 where the weight of v, equals the distanza 
between v, and v;, and v4 40 if v, 7 v2, Hence the free distance of a convolutional 
code is given by the minimum-weight sequence of any length produced by a nonzero 
input sequence. 


8.3 Generator matrices for convolutional codes 


The use of convolution to derive the output sequences is rather tedíous and as might 
be expected, the use of matrices can help to simplify encoding. We have seen that the 
output sequence v = u * g, where u is an input sequence, g is a generator sequence and 
« is the convolution operation. This equation can be expressed in matrix form, and 
the convolution operation replaced by matrix multiplication, by defining a gen- 
erator matrix G such that 


v = uG, (8.14) 


The matrix G is constructed from the components of the generator sequences and for 
an (n, k, m) convolutional code 


Go Gi Go ... Gm 0 Ü ou 
0 Go Gi G 


m () 0 Go Gi G) tee Cm ín ng (8,15) 
where G, is the k by n matrix 
gh gu gg 
(2,1) (2,2) (2,4) 
gejt yt (8.16) 
k, LU ! 
gl 1) gu 2) o, ge n) 
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x. Each row in G is obtained from the previous row by 
place to the right. If u has finite length L then G has 
On substituting eqn 8.16 into 8.15 the matrix G has 
For the (4, 3, 2) code already considered, we have 


natrices one 
columns. 


| | nd L+ p m) columns. 
ro vs and n(L + 3 
kL rows (141) (1.2) (1,3) gi A) 
(2,1) (22) (23) (24) 
- ( a 2) t 3) (34) 
ge! gr. 8r gr 


tor sequences already given for the (4, 3, 2) code (see section 8,2) we 
. genera 
p the Be 


Usin 
di 111 
Go=|0 1 0 
001 1 
00 0 0 
Gj=|0 1 1 0 
0 1 0 0 
0 0 0 0 
G2=]0 0 0 0|. 
001 1 


The generator matrix for the (4, 3, 2) convolutional code is therefore 


1111 0000 0000 0 0... 
0101 0110 0000 
0011 0100 0011 
0 1111 0000 0000 0... 
0101 0110 0000 
0011 0100 0011 
s 
0 O 1111 0000 0000 (8.17) 
0101 0110 0000 
0011 0100 0011 
Where 0 is 


the eel 3 by 4 zero matrix. Once the generator matrix is established finding 
Example à ie for a given input sequence is Straightforward. Reconsider 
2) ^ In Which the Output sequence for the input sequences u — (1 0 1), 


u =(1 10) and yO — 
the arts u- = (01 1) was found using convolution. The input sequence to 


T B 
u = (uf ul ^u uuu). (000,0) 
110,0 1, 1-0 1). 
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The generator matrix Gis the 9 by 20 matrix 


Atilt 0000 0000 0000 0000Q 
0101 OIIO 0000 0000 000 () 
0011] 0100 0011] 00040 00020 
OO00 TITEL 0000 0000 Og 0 () 
G 0000 OLOT O0IIO 0000 0000 
0000 QOLI 0100 0011] 0000 
0000 0000 LIII 0000 0000 
0000 0000 OIOI 0110 0000 
OO00 0000 OOILI OL00 OOF | 


and using i c ur ves 


"o (L010,0000,1 LLO OTI1,OO I I) 


which is in agreement with the answer obtained in Example 8.4. 


8.4 Generator polynomials for convolutional codes 


Whilst the use of generator matrices is an improvement over the use of convolution, 
Us still nevertheless awkward due to the large size of the generator matrices, 
However, encoding ean be further simplified through the use of generator poly- 
nomials, Consider the input sequence ^ (Hou oss. h i cun be represented by 
the polynomial 


u( D) uy by D I i D^ ove (8.14) 


where D is the unit-delav operator and represents a delay of I bit, p represents a 
P bit delay and so forth, In eqn 8, 18 a) is interpreted as being delay by I bit relative to 
vo. that is, itarrives | bit later than up. The bit i» is delayed by 2 bits relative to u and 
| bit relative to i4, Given an output sequence v (Vo Vi Va.. )wecan likewise write 


WD) = ve D AnD? ope (8,19) 


The polynomials u( V) and v(D) are referred to as the input polynomial and outpul 
polynomial respectively, I v(D) is the output arising from u(D) then 


u( D)g( D) (8.20) 


v(D) 
where g(D) is a generator polynomial, The product u DeC D) is constructed using 


polynomial multiplication subject to modulo-2 arithmetic, 


lxaimnple 8.5 l i | | 
Given the arbitrary polynomials u(D) 1+ D^ 4 D and g(D) «b+ D then 


(1 + D? + D')(E + D") 
ID 4 D? DH D + Do 
| D? 4+ D? 4. D^. 


v( D) 


, 
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ator polynomial can be determined directly from the encoder. jy 
t$ i 


ay as the generator sequences are determined. Each link to a modulo? aa 
same W tes a D” term to the generator polynomial where , is the number of st: E 
contriPh has to pass through to arrive at the adder. The sth Component of the 
that — sequence g = (081 82--- 8m) İs O or 1 dependi 
ene 


ng on whether, after the 
" there is a link to the adder, and therefore the rth component in the genera 
Se ivnomial can be written as g,D' . Hence, for m Stages, the generator polynor 
a ( 


can be expressed as 


thie 
nh 
lor 
fija] 


g( D) = go giD-- gD? +... 4 Is D" (8.21) 


Example 8.6 | | | 
Determine the generator polynomial of the shift register shown in Fig, 8.2 Hence 
find the output sequence given the input sequence u=(100 i). 


We have already seen that the generator sequence of the en 


coder shown in Fig, 4.2 is 
g=(10 1 1) and the generator polynomial is therefore 


8(D) = 804+ 21D + gD +. 93D? = 14 p24 p? 
The input polynomial corresponding to the input sequence u = (] () 0 lj is 


u(D) = uo + uu D + u; D^ + uy D? em 1+. | 


and the output polynomial is therefore 


»(D) = u(D)g(D) 
= (1 + D + D? + p^ 
= | + D? + D5 + pé 


giving the output sequence 


v = (vo vi v v3 V4 vs V9) 2 (10100 1 1). 


The results agree with that obtained using convolution in Example 8.2. E 


- 


An (n, k, m) Convolutional code has k generator polynomials for each of the n 
Output sequences and therefore a total of nk generator polynomials. Let 


m 
g^) (D) — i» g^ D' (8.22) 
r=0 
be | e | 
s the Benerator polynomial for the jth output arising from the ith input, where the 
polynomia] C | 


A fi. f. 
oefficients gr”) are the components of the generator sequence g E 
^ 2) encoder shown in Fig. 8.5 has 12 generator polynomials of the form 


g^ (p) — gh a gp + gi p. 


CT 
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: e ^ n oe - E and j= 1,2, 5, and 4, along with the generator ges jusnies giyen 
p (p) = 1, g (D) = 1, gD) = 1, I y) us | 
g^ (D) 0, g^ P (D) = 1 + D, g^ (D) = p, PANDY = | 
g (D) = 0, g' (D) = D, (D) = 1 + D, g MID) agp gi 


Ihe Ah output polynomial is a linear combination of the contributions from each e f 
the k inputs and is given by í 


" 
/^(p) = 3 V (Dg UD), (8.23) 


Example 8.7 
Consider again the (4, 3, 2) code with input sequence if") (] 0 1), MERTI j fj) 
and u ° (0 1 1) The corresponding input polynomials are ' 


uPD) = 14 D? 
uD) = 1 + D 
uP (D) = D + D’. 


Using egn 4.23 and the generator polynomials g^"(/)) already derived, the first 
output polynomial is 


VOLD) = uP (pg (p) 4 uP Dg PUD) + uO (Dg (p) 
(14 D+ 4 D)O (D 4. D*O 
| +D’ 
and the second 
VOD) = u^ (D)g"? (p) + uP (Dg ?(p) + u” (Dg D) 
(14 D^) e (O4 D+ D) + (D+ D)D 
D? + D', 
Likewise V ?(D) and v*(D) can be determined so giving 
VIP p) = 4 p 
y/D(D) = D^ + D’ 
VD) = 1 + D? + D? + D^ 
y? (D) = D + D^, g 


The output polynomial v(D) has contributions from y (D), yD)... WD) 
suitably delayed to take into account the order in which bits leave the encoder and it 


can be shown that 


v( D) = y p! yhp (8.24) 
j=l 


The components of v are then given by the coefficients of YD). 


p Q 


ixample HH 
Phe outpiul po 


(D) e vp | DW) | DVO) gc DAD) 
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iynomial ve D) For the (4,4, 2) ende, piven hy equ H 74 ja 


and wing v (0), WD), YD), and vo obtained in Vyample K 7 wives 
«p = EB pDUP BEV) (IL gp Pg Dy phy y PP y qu 
aA D DP DE p qc phy qup psy qur y qum 
Pxpressing this as the veetor 
vc Og Pi Y) Vas VA Va VA VI, Va Vo VIG Vii, VIR Via Via Vig, Vig Viy Pig Viy) 
piven 
v"-(01010,0000,1110,001 E4,001 I) 


this therefore is the output given the inputs i" —() 0 1), V" = 1 0), and 
u^ (0 1 1) and is the sume as that obtained before, using convolution and using 
matrices [ ] 


The output polynomial UD) can be expressed directly in terms of the input 
polynomials, substituting eqn 8,23 inte ean H; 24 pives 


Á 
vD) = à IP Ur WD) (8,25) 
jas 
where 
- 
g^ (D) = 2. D! git (4.26) 
j= 


is the generator polynomial of the ith input summed over all n outputs 


Example 8,9 
The (4,3,2) code has generator polynomials gD), (D), and "p 
representing the individual contributions of the three inputs to the total (ut put 
from the encoder. From eqn 5.26 we get 

gD) = g (p) 4 Dg ND) A Dg (phy 4 DY) 

g” (D) w g (p 4 Dg ^ 9 (DN) 4. Dg’ WD) A DAD) 

gD) = gO) 4 Dg! DD) t DDA) a. DONAA) 


and su bstituting the generator polynomials gives 


gD) = Í+ DD «p 
4? (D) s D+ D D 4 [Y 
g?(D) ae [ * p’ a$ p’ 4 p? 4 p, 





i. 
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bak | onvolional cedes 
Howe onee apad consider He inputa ii — (10 D, uP = (410 and ti) 
ibat at Ne d Ir a NN) o d DD aad uU) DA pid A = (0 I), 86 
piiri Ing eqn 8.25 
TERN "UTD | u” pg ? (p) JJ u^ (D^)g 9) (D) 
UL Bit EP DÀ FD) + + DÜÓCGD + DÀ 4. D5 4 py 
US a DU) DI 4. DP + D^ + D 4 pl) 
poy pty py D" 4 pP + p D'S a ples pi 
[] 


as nohta ii Fsample BR 


n5 Graphical representation of convolutional codes 


Convelitional codes can be represented graphically using tree, trellis and state 
dign na al od whieh slow the state of a register and the encoder output for all 
possible inputs The vare ob a register is defined as the contents of the stages at 4 
aien polit cling encoding, Phe diagrams provide an interesting way of looking at 
ihe atthe amd encoding of convolutional codes, and furthermore, the trellis 
diram plays an important cole when decoding using the Viterbi algorithm (con- 


sidered ii Section K 6). 

We first eenadder vate diagrams. Figure 8.6 shows an encoder for a (2, 1, 2) con- 
velitional code, Atany point during encoding, the encoder can be in one of the 
datate OO. OF EO and EE, referred to as states So, Si, 52, and S; respectively. The 
shown in big. H7 as nodes (filled circles) connected together by branches 


atutes ue 
puli or clashed lines) that represent transitions from one state to another, 
ii is | (solid line) or 0 (dashed line). The output 


eceurring With each transition is shown next to the relevant branch. The state dia- 
gran gives a complete description of encoding in that for a given input the output 
aid the nest state of the encoder can be determined, To arrive at the state diagram 
we need to consider the operation of the encoder, taking in to account all possible 


depending upon whether the inp 


teanal HiS 





hin HO A (2 I) convolutional encoder. 








i 


Graphical representation of convolutional codes | 247 


10 


-—-- QO input 
=. $ input 





Fig. 8.7 State diagram for the (2, 1,2) convolutional code. 


Referring to Fig. 8.7 we assumé that encoding starts at Sọ, that is at the zero state 
with the stages at 00. Whilst the input stays at 0, transitions occur to the same state So 
and the output is 00. At the first nonzero input, the stage contents change to 10 and 
the transition is to $5 giving an outputof 11. If the next input is also a 1, then the stage 
contents change to 11, the transition is to S, and the output is 01. Otherwise a 0 input 
gives a transition to S, and an output of 10. The state diagram is completed by 
considering transitions from S, and S, for inputs 0 and 1. Given an arbitrary input 


u = (ug U; U2...) the output can be determined by following the transitions through 
the state diagram. 


Example 8.10 


Consider the input sequence u —(110 1 0 0). Referring to the state diagram in 
Fig. 8.7, and starting from the state Sp we get 


Input 1, transition to S; giving an output 11 
Input 1, transition to S; giving an output 01 
Input 0, transition to S; giving an output 01 
Input 1; transition to S; giving an output 00 
Input 0, transition to S, giving an output 10 
Input 0, transition to So giving an output 11 


The Output sequence is therefore y = (11, 01, 01, 00. 10. 11) i 
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Fig. 8.8 Tree diagram for the (2, 1,2) convolutional code. 


Figure 8.8 shows a tree diagram for the (2. 1.2) code. This agam shows tam- 
sitions from state to state, with corresponding outputs, for all mputs. The state 
and tree diagrams differ in that the latter shows the evolution of encodimg with 
time. In the state diagram there is no way of knowing how a state was armved at. 
from any specified state it is only possible to determine the next state and output 
for a given input. In the tree diagram moving from left to right represents the flow 
of time as the input sequence enters the encoder. At any node transitions can only 
occur to one of the two nodes to the right of the node. The output at each tram- 
sition is shown above the horizontal portion of each branch. Encoding starts at the 
far left at S,and progresses from left to right. The tree diagram shown in Fig. &.8 has 
been truncated after the 4th input, but theoretically the tree extends to the right 
infinitely. 

A tree diagram gives an interesting graphical view of a convolutional code but is of 
limited practical use due to its size. However tree diagrams have à repetitive struc- 
ture that allow the diagrams to be simplified whilst maintaining the basic feature of 
showing how encoding progresses with time. The resulting diagrams are known 35 
trellis diagrams and Fig. 8.9 shows the trellis diagram for the (2, 1, 2) code. The trellis 








Time 


Fig. 8.9 Trellis diagram for the (2, 1, 2) convolutional code. 
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Input 1 1 0 1 0 0 
Output 11 01 01 00 10 11 


Fig. 8.10 Trellis when encoding u —(1 1 O 1). 


consists of 4 rows of nodes representing states So, S1, S2, and S3. Each column in the 
trellis contains 4 nodes and transitions occur from a specified node to one of two - 
nodes in the column to the right of the specified node. Again solid and dashed lines 
represent inputs | and 0 respectively, and the outputs are shown next to each branch. 
Encoding starts at the state Sp at the bottom left-hand node. On the left of the trellis, 
some nodes have been omitted because they represent states that cannot be reached 
from the initial state Sp in the first »? encoder inputs. Every path in the trellis, from 
one node to some other node to the right represents an encoded sequence.-Each 
column of nodes is identical in that nodes in the same row have the same branches 
irrespective of the column that a node lies in, except at the start and end of the trellis. 
For clarity, the middle section of Fig. 8.9 shows the current state and next state, with - 
corresponding output, for each input, and the trellis is obtained by repeating this 
section. The trellis diagram is the most useful of the three graphical representations 
of convolutional codes. It clearly illustrates the finite states of a convolutional code 
as well as showing how encoding and decoding evolve with time. 

Figure 8.10 shows the trellis when encoding u — (1 1 0 1). The encoder starts at the 
zero state Sp and the first input 1 causes a transition to state $5 and an output of 11. 
The next input | gives the state S, with corresponding output 01 and so forth for the 
3rd and 4th inputs. Two additional 0 inputs are required to returtíthe encoder to its 
zero state, giving a final output of v — (11, 01, 01, 00, 10, 11). 


8.6 The Viterbi decoder 


A decoder for a convolutional code has to establish the path through the code trellis 
that corresponds to the decoder input w. Thc Viterbi algorithm is a maximum- 
likelihood decoder that determines the path that w most likely corresponds to. This 
path is then taken to be the encoder output v, from which the encoder input u can be 
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Fig. 8.12 Trellis for decoder input with no errors. 
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petet miine ihe generator sequence of the shift register shown in Fig. 82. 
Hence using convolution, determing the output sequences wher the input 
gee HENES HIE 


peternie the generator sequences for the (wo outputs of the shift register 


shown in Fig H, 4 


show that the generator sequences connecting the input to the output 
sequenced of the (4; 5, 2) convolutional code, shown in Fig, 8.5, are given by 


equa HH. Hence, using eqns 8,10 and 8,12, show that rth components of the 
output sequences are. given by eqns 8.13. 


A Cuven the inpuis "ALESTI 1 | 0), u” — (1 0 0 1), and u= (0 10 1) to the 


(4, 3, 2) code use equa 8.13 to determine the output sequerice v. 


Diaw an encoder for the (2, 1, 3) convolutional code with generator sequences 
g (00 d 1) and gH EDD). 


Determine à generator matrix for the (2, 1, 3) code described in Problem 5.5. 
Hence find the output y when u (0 10 1). 


Using the generator matrix for the (4, 3,2) code find » when a’? — (1 00 4), 
wf —(0 4100) and i" — (0 10 1). 


Determine. the generator. polynomials corresponding to the 12 generator 
sequences connecting the input sequences to the output sequences of the 
(4, 3,2) code, Therefore determine the generator polynomials g/" (D), g^ (D) 


and g' (D), and find the output y when uP — (100 1), u^ «(1 1 0 0), and 
t 5) 
u (0 | |), 
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